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(57) ABSTRACT 

In an operating system (OS) for a multimedia communica- 
tions center (MMCC), an interactive process module (IPM) 
for accomplishing a process has a plurality of code sets, each 
adapted to completion of a specific task in the overall 
process, an input interface for providing one or more inputs 
to the IPM, and an output function for returning a result. The 
plurality of code sets are related by pre-requisite status, 
creating a required order of progression for the process, the 
process is initiated after being called by the OS and receiv- 
ing required inputs, the IPM is adapted to interface with 
other OS modules for accessing and providing data, and 
upon completion of the last task the IPM returns the result. 
In one embodiment the IPM is represented by an interactive 
GANT chart. In a preferred embodiment a tool kit is 
provided for a programmer to create such IPMs to perform 
business processes. IPMs thus created may be displayed and 
edited as object models. 

18 Claims, 14 Drawing Sheets 
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INTERFACE ENGINE FOR MANAGING telephone number of the calling line is made available to the 

BUSINESS PROCESSES WITHIN A receiving switch at the call center by the network provider. 

MULTIMEDIA COMMUNICATION-CENTER This service is available by most networks as caller-ID 

information in one of several formats such as Automatic 

CROSS-REFERENCE TO RELATED 5 Number Identification (ANl). Typically the number called is 

DOCUMENTS available through a service such as Dialed Number 

The present application is a continuation-in-part (CIP) of IdentificationService (DNIS). If the call center is computer- 

copending application Ser. No. 09/151,429, P3317 applica- enhanced (CTI), the phone number of the calhng patty may 

lion Ser. No. 09/183,551, P3316, application Ser. No. ^e used as a key to access additional information from a 

09/182,745, P3315 application Ser. No. 09/151,429, P3314 customer mformation system (CIS) database at a server on 

application Ser. No. 09/151,710, and P3313 application Ser. network that connects the agent workstations. In this 

No. 09/151 ,564 all of which are incorporated herein in their ^^^^^^ mformation pertment to a call may be provided to an 

entirety by reference. ^g®"^' ^ screen pop on the agent's PC/VDU. 

In recent years, advances in computer technology, tele- 

FTELD OF THE INVENTION 15 phony equipment, and infrastructure have provided many 

The present invention is in the field of telecommunication opportunities for improving telephone service in publicly- 
encompassing all existing sorts of interaction multimedia switched and private telephone intelligent networks, 
technology, and pertains more particularly to methods and Similarly, development of a separate mformation and data 
apparatus for managing defiaed business processes within a network known as the Internet, together with advances in 
multimedia communication-center operating a customer- computer hardware and software have led to a new multi- 
interaction-network-operating-system (CINOS). media telephone system known in the art by several names. 

In this new systemology, telephone calls arc simulated by 

BACKGROUND OF THE INVENTION multimedia computer equipment, and data, such as audio 

In the field of telephony communication, there have been is transmitted over data networks as data packets In 
many improvements in technology over the years that have ^^"^ the broad term used to descnbe such computer- 
contributed to more eflBcient use of telephone communica- ^miulated telephony is Data Network Telephony (DNT). 
tion within hosted call-center environments. Most of these purposes of nomenclature and definition, the mven- 
improvements involve integrating the telephones and tors wish to distinguish clearly between what might be 
switching systems in such call centers with computer hard- called conventional telephony, which is the telephone ser- 
ware and software adapted for, among other things, better vice enjoyed by nearly all citizens through local telephone 
routing of telephone calls, faster delivery of telephone calls companies and several long-distance telephone network 
and associated information, and improved service with providers, and what has been described herein as computer- 
regard to client satisfaction. Such computer-enhanced tele- simulated telephony or data-network telephony. The con- 
phony is known in the art as computer-telephony integration „ ventional systems are referred to herein as Connection- 
(CTi). Oriented Switched-Telephony (COST) systems, CTI 

Generally speaking, CTI implementations of various enhanced or not. 
design and purpose are implemented both within individual The computer-simulated, or DNT systems are familiar to 
call-centers and, in some cases, at the telephone network those who use and understand computers and data-network 
level. For example, processors running CTI software appU- 4Q systems. Perhaps the best example of DNT is telephone 
cations may be linked to telephone switches, service control service provided over the Internet, which will be referred to 
points (SCPs), and network entry points within a public or herein as Internet Protocol Network Telephony (IPNT), by 
private telephone network. At the call-center level, CTI- far the most extensive, but still a subset of DNT. 
enhanced processors, data servers, transaction servers, and Both systems use signals transmitted over network links, 
the like, are linked to telephone switches and, in some cases, 45 In fact, connection to data networks for DNT such as IPNT 
to similar CTI hardware at the network level, often by a is typically accomplished over local telephone lines, used to 
dedicated digital link. CTI processors and other hardware reach points in the network such as an Internet Service 
within a call-center is commonly referred to as customer Provider (ISP). The definitive difference is that COST tele- 
premises equipment (CPE). It is the CTI processor and phony may be considered to be connection-oriented tele- 
application software is such centers that provides computer 50 phony. In the COST system, calls are placed and connected 
enhancement to a call center. by a specific dedicated path, and the connection path is 

In a CTI-enhanced call center, telephones at agent stations maintained over the time of the caU. Bandwidth is basically 
arc connected to a central telephony switching apparatus, assured. Other calls and data do not share a connected 
such as an automatic call distributor (ACD) switch or a channel path in a COST system. A DNT system, on the other 
private branch exchange (PBX). The agent stations may also 55 hand, is not dedicated or connection-oriented. That is, data, 
be equipped with computer terminals such as personal including audio data, is prepared, sent, and received as data 
computer/video display unit's (PC/VDU's) so that agents packets over a data-network. The data packets share network 
manning such stations may have access to stored data as well links, and may travel by varied and variable paths, 
as being linked to incoming callers by telephone equipment. Recent improvements to available technologies assod- 
Such stations may be interconnected through the PC/VDUs 60 aled with the transmission and reception of data packets 
by a local area network (LAN). One or more data or during real-time DNT communication have enabled corn- 
transaction servers may also be connected to the LAN that panics to successfully add DNT, principally IPNT, capabili- 
interconnects agent stations. The LAN is, in turn, typically ties to existing CTI call centers. Such improvements, as 
connected to the CTI processor, which is connected to the described herein and known to the inventor, include methods 
call switching apparatus of the call center, 65 for guaranteeing available bandwidth or quality of service 

When a call arrives at a call center, whether or not the call (QoS) for a transaction, improved mechanisms for 

has been pre-processed at an SCP, typically at least the organizing, coding, compressing, and carrying data more 
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efficiently using less bandwidth, and methods and apparatus manner that provides seamless integration between media 

for intelligently replacing lost data via using voice supple- types and application types, thereby allowing agents to 

mentation methods and enhanced buffering capabilities, respond intelligently and efficiently to customer queries and 

In addition to Internet protocol (IPNT) calls, a DNT problems, 

center may also share other forms of media with customers s Still another goal of multimedia communication centers is 

accessing the system through their computers. E-mails, "^^^^^^i" ^ ^^^ain flexibility with regard to defined 

Video mails, fax, file share, file transfer, video calls, and so ^'^^"^^ processes that may be ^ed or in effect within the 

forth are some of the other forms of media which may be communication center. For example, enterprise procedure 

used. This capability of handling varied media leads to the "^^^^ executed m a tmiely fashion and m logical order 

term multimedia communications center A miiltimedia lO especially where hve interacUons hang xn the balance. A 

communications center may be a combination CH and DNT f^""^ patronizes a multimedia communication center 

center, or may be a DNT center capable of receiving COST ^^es not wish to be inconvemenced by a long wait while a 

calls and converting them to a digital DNT format. The term business procedure relating to his call is being executed 

communication center will replace the term call center ^® system. 

hereinafter in this specification when referring to multimedia 35 Business procedures, as described above, include and 

capabilities encompass any ordered processes that may be required 

In typical communication centers, DNT is accomplished " "'"d'^ion reached regarding an issue or 

bylntemetconnectionandlPNTcaUs. For this reason, IPNT '^'>'«=^'- ^ ^^I^^^^ fj: ^'^"''t '"1^"'^ procedure may 

and the Internet will be used in examples to foUow. IT » P™'^^^ for qualifying a client for a loan. A harness 

should be understood, however, that this usage is exemplary, ^ Pra<*dure as such may be broken down into ordered steps 

and not Umitin * sub-steps. For example, an automated business apph- 

, . . rri^T^ cation designed to qualify or not a requesting client may 

In systems known to the mventors, mcommg IPNT calls ^ ;„ ^jj^^j identification and data acqui- 

are processed and routed withm an IPNT-capable commxi- ^j^^^ Siib-steps involved in client data acquisition may 

nication center m much the same way as COST calls are ^ ^^^^^ ohi^mm^ last credit report, 2) obtaining past 

routed in a Cn-enhanced call-center, usmgsmiilar or iden- ^^^^ enterprise, 3) obtaining current 

tical routmg rules, waiting queues, and so on, aside from the • „„„ „„j ««j c« X« 

' * , mcome and asset mrormatxon, and so on. 

fact that there are two separate networks involved, Comm\i- -^uu-u* * a j- 

... * L • u ,u jTDKrr u'lv *-\' An 1SSU6 With which to Contend regarding current art 

nication centers having both Cn and IPNT capabiuty utilize . ^. . • .u ^ . »u . u • * • 

T * J : * u u • communication centers is the fact that human mtervention IS 

LAN-connected agent-stations with each station havmg jl r- Viju- 

telephony-switch-connected headset or phone, and a PC '° «qu'«d when perforimtig more cornplicaled business pro- 

, \i ■ , ■ T AKT * *- 1 • cesses such as the one described above. For example, an 

connected, in most cases via LAN, to the network carrying , ^ , . , , « . • 

the IPNT calls. THerefore, in most cases, IPNT caUs are °P"»t°'.°f f^^} required to manually type m access 

, , , nr> u-1 1 * I t, II to certain databases via keyboard. Obtained information 

routed to the agent s PC while conventional telephony calls ^ , , . ^ . 111 

i.iu u j. must be processed, in many instances, via manual calcula- 

are routed to the agent s conventional telephone or headset. „ ^ 1 • * j u* *• /• r 

^ . ,1 J . / * L • 1 35 tion such as calculatme mcome to debt ratio (m the case of 

Typically separate lines and equipment must be imple- , \j t^ ^ul - i 

. A P u ♦ P 11 .u r^/^e-r Toivrr ^ loan process) and so on. Because of such human involve- 

mented for each type of call weather COST or IPNT. , ' , - ^ • 1 

^ . , , . . , naent in one or more stages m a typical process, the pro- 
Due in part to added costs associated with additional ^.^^^ ^ ^ ^^^^ interference consumes 
equipment, imes, and data ports that are needed to add IPNT ^-^^ ^^^^^^^^ enterprise and to the client. Beyond 
capabihty to a CTI-enhanced call-center, compames are that, if someone "drops the ball", the transaction may not be 
currently cxpenmentmg with various forms of integration ^^^^^ ^^^^ ^ ^-^^^^ .f impossible to find 
between the older COST system and the newer IPNT in time at which manual step the issue was dropped, 
system. For example, by enhancing data servers, interactw^ ^^^^ ^ ^^^^^^ ^ ,^ ^ multimedia 

voice response units (IVR s), agent-connecting networks, ... , c *• - , 

, ^ ^ . „ • . w . I communication center tor creating interactive process 

and so on, with the capability or conrorming to Internet >c .„ *u *u« • 

, ' , , , ' r -.1 .1 . ^5 modules, interactive with other communication center 

protocol, call data arriving from either network may be . u n j * ■ 1 1 c 1 

r ^ . . , ^ . ^ ... . r -I-. . processes, that can be called to quickly perform particular 

integrated requiring less equipment and lines to facilitate j « j . ^ • j ■ 1 

^ . 7 ^ , . c r -i . denned processes according to enterprise needs in a timely 

processing, storage, and transfer of data. jji^i.- u-l i_ 

^ ^ * and orderly fashion wherein human intcrvenUon may be 

With many new communication products supporting van- excluded or greatly reduced, 

ous media types available to businesses and customers, a 50 

communication center must add significant application soft- SUMMARY OF THE INVENTION 

ware to accommodate the diversity. For example, e-mail In a preferred embodiment of the present invention, in an 

programs have differing parameters than do IP applications. operating system (OS) for a multimedia communications 

IP applications are different regarding protocol than COST center (MMCC), an interactive process module (IPM) for 

calls, and so on. Separate routing systems and/or software 55 accomplishing a process is provided, comprising a plurality 

components are needed for routing e-mails, IP calls, COST of code sets, each adapted to completion of a specific task in 

calls, file sharing, etc. Agents must then be trained in the use the overall process; an input interface for providing one or 

of a variety of applications supporting the different types of more inputs to the IPM; and an output function for returning 

media. a result. The plurahty of code sets are related by pre- 

Keeping contact histories, reporting statistics, creating 60 requisite status, creating a required order of progression for 

routing rules and the like becomes more complex as newer the process, the process is initiated after being called by the 

types of media are added to communication center capabil- OS and receiving required inputs, the IPM is adapted to 

ity. Additional hardware implementations such as servers, interface with other OS modules for accessing and providing 

processors, etc. are generally required to aid full multimedia data, and upon completion of the last task the IPM returns 

communication and reporting. Therefore, it is desirable that 65 the result. 

interactions of all multimedia sorts be analyzed, recorded. In a preferred embodiment task structure and parameters 

and routed according to enterprise (business) rules in a are presentable in a graphical interface displaying tasks 
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making up the IPM in prerequisite order. The graphical FIG. 11 is a process flowchart illustrating logical steps for 
interface may be a GANT chart. Preferably the graphical building an IMA for a user interacting with CINOS accord- 
interface is interactive, allowing a programmer to add, ing to an embodiment of the present invention, 
delete, and edit steps in the process. FIG. 12 is a block diagram illustrating the relationship 

In some cases start and finish times are displayed for each ^ between a mass repository, an interaction object model 

task. Also in some cases, in performing any one task, next (lOM interface), and data-interaction systems according to 

activity is variable, and is determined by performance to an embodiment of the present invention, 

requirements programmed with the task. Task requirements FIG. 13 is an exemplary flow chart illustrating interactive 

may include completion within a preprogrammed allotted steps associated with TOM functionality according to an 
time. Next activity may include a choice of stopping the lO embodiment of the present invention, 

process and notifying a person in the event of non- piG. 14 is a Gant table illustrating a pre-defined business 

completion of a task in an allotted time. process according to an embodiment of the present inven- 

In some cases one or more tasks require human inlerven- tion. 
tion and activity, and there may be a selective activity of 

reminding a person responsible for an activity of a pending DESCRIPTION OF THE PREFERRED 

time deadline EMBODIMENTS 

In another aspect of the invention an operating system for FIG. 1 is a multimedia communications center enhanced 

a multimedia call center is provided, including IPMs of the with a network operating system according to an embodi- 

lype and structure described in general above. Further, a tool nient of the present invention. A telephony-network archi- 

kit for a programmer provides an interactive object-oriented lecture 11 comprises an enterprise -hosted communication 

interface adapted for building IPMs of the sort described. center 17 that is linked to, in this example, both a publicly- 

The invention in its various embodiments, taught in switched telephone network (PSTN) 13, and a wide area 

enabling detail below, provides a facility for adapting an ^^^^^o^k (^AN) 15, which may be the pubhc Internet or 
operating system for a multimedia call center to specific 25 ^^^^ ^^^^^^ network, such as a company Intranet, 

business practices and rules for a host enterprise within a In this particular embodiment communication center 17 

broad set of possibilities, wherein business procedures, such handles both conventional telephone calls, which may be 

as logical and calculation intensive procedures, may be categorized as connection oriented switched telephony 

accomplished more or less automatically with litUe if any (COST) calls, and data network telephony (DNT) calls, 
human intervention. 30 which may be DNT calls over a private digital network or 

calls according to a protocol such as the well-known Internet 

BRIEF DESCRIPTION OF THE DRAWING protocol. DNT calls are characterized in that data is trans- 

FIGURES mitted as addressed data packets as opposed to dedicated 

^ ^ . . . . connections in COST calls. As indicated, PSTN 13 may be 

FIG. 1 IS a diagram of a multimedia communications ^ p^^^^^^ ^^^^er than a pubUc network. WAN 15 may be a 

center enhanced with a network operating system accordmg company Intranet, the Internet, or another type of WAN 

to an embodiment of the present invention. ^he particular method of call delivery and 

RG. 2 is a block diagram illustrating basic layers of a call center integration is not particularly relevant for the 

customer interaction operating system according to an purposes of this invention. There are many ways known both 

embodiment of the present invention. to the inventor as well as known in the art. Particular issues 

FIG. 3 is a flow chart illustrating basic steps performed by discussed in the disclosure between the telephones and the 

the network operating system of FIG. 2 related to complet- computers might be implemented differently depending on 

ing interactive transactions between business partners. the actual system, but shall be deemed equivalent for all 

HG. 4 is a block diagram illustrating agent-desktop purposes of this invention, 
function according to an embodiment of the present inven- 45 Incoming COST calls arrive at a network-level telephony 

tion. switching apparatus 19 in network cloud 13 and are con- 

FTG. 5 is a block diagram of an exemplary WEB-form °^cted over trunk 23 to a central telephony switching 
customer interface according to an embodiment of the apparatus 27 within communication center 17. From switch- 
present invention "^S apparatus 27, calls are routed according to existing 

FIG. 6 is a flow chart iUustrating media-presentation and 50 ro^tiag njles over internal wiring 56 to agents' telephones 

• ^ c 1 • . J* * L J* * 47, 49, 51, and 53 residing at agents workstations 31, 33, 

customer-interface logic steps according to an embodiment -ic h it r i 

of the present invention. J5 and J7 respectively. 

_ . , • ^ u- J- • . Incoming DNT calls, and other communication events 

FIG. 1 IS an exemplary overview of a multimedia mter- ^^^^ ^ ^^^^^^^^^ ^^^^^ ^ ^^^^ 

action storage system withm a communication center node 21 in WAN 15 and are passed on over digital connec 

according to an embodiment of the present invention. ^-^^ 25 to a routing server 29 within communication center 

HG. 8 is a block diagram of the repository of FIG. 7 17. Once calls arrive at server 29, they may, in some 

illustrating threaded text-blocks and their relationship to embodiments, be routed directly over LAN 55 according to 

stored multimedia according to an embodiment of the existing routing rules to personal computerMdeo display 

present invention. units (PCA^DU) such as PCA^DU 39, 41, 43, or 45 located 

FIG. 9 is a process flow chart illustrating logical steps at agent's workstations 31, 33, 35, and 37 respectively, 

taken when building a threaded multimedia contact-history in this embodiment, switch-connected telephones 47-53 

of communication-center interactions according to an are also connected to PCA^DU's 39-45 via a headset to 

embodiment of the present invention. computer sound-card according to technique known to the 

FIG. 10 is a block diagram illustrating an interactive 65 inventor and accomplished via an I/O cable. Thus 

multimedia application (IMA) tool kit and a created appli- connected, agents may respond to incoming COST and DNT 

cation according to an embodiment of the present invention. calls with the same headset. 
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In the exemplary system and communication center 
shown, the equipment and applications are adapted to pro- 
vide for multimedia operation at each of the agent stations, 
so the agents can interact with clients in many different 
ways, as are known in the multimedia arts. 

Computer telephony integration (CTI) enhancement is, in 
this embodiment, provided both at communication center 17 
and in PSTN 13. For example, in PSTN 13, a processor 61 
running instances of a CTI application known as a T-scrver 
(TS) to the inventors, and a statistics server (Stat) is con- 
nected to telephony switch 19 via CTI link 65. An intelligent 
peripheral 59 of the form of an interactive voice response 
unit (IVR) is connected lo processor 61 via data connection 
63. Similar CTI equipment is illustrated within communi- 
cation center 17. Namely, a processor 67 running instances 
of TS and Stat and connected to telephony switch 27 via CTI 
link 71, and an IVR 69 connected to processor 67 via a data 
connection 73, with processor 67 further connected to a local 
area network (LAN) 55 within communication center 17. 

In alternative embodiments there may also be a CTI 
processor 22 in WAN 15 connected to server 21 by a CTI 
link 24. Also in some embodiments a separate data network 
66 connects these CTI processors. In this way, intelligent 
routing may be performed at the network level with nego- 
tiation and direction from within communication center 17. 

It will be appreciated by those with skill in the art that the 
CTI enhancements, as immediately described above, may be 
hosted on one processor at PSTN 13 and on one processor 
at communication center 17 without departing from the 
spirit and scope of the present invention. The inventor has 
chosen to show separate processors having separate func- 
tions for exemplary purposes only. It will also be appreciated 
by the skilled artisan that there may be many more or fewer 
than the four agent stations shown in communications center 
17, and hardware and software arrangements may be made 
is a variety of ways. Also, home agents might be connected 
in a variety of ways to the call center. 

In a prefened embodiment of the present invention, a 
customer-interaction network operating system, hereinafter 
termed (CINOS), is provided for the purpose of managing 
communications center 17, and optimizing and recording all 
agent/customer interactions received at communication cen- 
ter 17 from networks 13 and 15. CINOS is unique in the fact 
that it is a multi-tiered object-and process-orientated system 
wherein logic regarding the various aspects of it's function- 
ality is achieved via knowledge-based architecture and 
object modeling. Various functions of CINOS, more fully 
described below, include capturing (recording), analyzing, 
routing, and, in many instances, responding via automated 
process to customers engaged in interactions with the enter- 
prise (company hosting the communication center). CINOS 
is adapted to support all planned communication mediums 
such as multimedia DNT applications including e-mail, 
video mail, file transfers, chat sessions, IP calls, and CTI 
COST transactions such as voice calls, voice mails, faxes, 
and so on. 

Referring back to FIG. 1, CINOS utilizes various LAN- 
connected machines in order lo perform various operations. 
Among these various hardware implementations are a mul- 
timedia server (MIS) 79 adapted to physically store and 
serve all multimedia transactions, and a customer- 
information-system server (CIS) 57 adapted to physically 
store and serve information relevant to customers such as 
purchase history, financial status, product preferences, con- 
tact information, etc. A central server (COS) 77 acts as a host 
location for a CINOS manager apphcation (noted in text 
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balloon) which is, in effect, the parent application that 
controls all of the operation and functionality of the system. 

In addition to the above-mentioned machines hosting 
CINOS rouUnes, each PCA^DU such as PCA^DU 39, for 

5 example, has a QNOS -agent desktop interface or client 
application (not shown) adapted to interact with the parent 
application. Also, each machine that provides particular 
dedicated function to communication center 17 such as 
switch-connected CTI processors, IVR*s, and other related 

10 equipment host instances of CINOS application-program 
interfaces (API's) to enable seamless integration of differing 
parameters and/or protocols that are used with various 
planned application and media types utilized within com- 
munication center 17. Such programs may also co-reside or 

15 be in any combination or hosted by themselves. 
Additionally, for performance purposes, additional dedi- 
cated network links may exist between those servers, but 
essentially they arc only performance boosters, and hence 
for clarity purposes, only a simple network is shown. 

As previously described, CINOS comprises a multi-tiered 
architecture. This unique architecture comprises an external 
media layer for interfacing with the customer or business 
contact, a workflow layer for making routing decisions, 
organizing automated responses, recording transactions, and' 
so on, and an internal media later for interfacing and 
presenting interactions to an agent or knowledge worker An 
innovative concept associated with CINOS involves the use 
of tooled process models, knowledge bases, and other object 
models as base instruction for it's various functions. These 
modular conventions may be inter-bound with each other, 
and are easily editable providing a customizable framework 
that may conform to virtually any existing business logic. 
In simple operation, and after any network level routing, 

2^ COST calls and DNT calls including other media events 
arrive at communication center 17 to telephony switch 27, 
and routing server 29 respectively. Network level routing, as 
defined herein, includes any intelligent implementation that 
may be in place and aided via processors 59, 61, and 22. 
Load balancing to multiple communication centers, and 
transferring customer data obtained at network-level over 
data-network connection 66 would be examples of such 
network-level routing. 

Once a call or other communication event registers at 

45 either switch 27 or routing server 29, CINOS immediately 
identifies the media type associated with the call and begins 
it's processes depending on enterprise rules. For example, a 
live COST call may first be routed to IVR 69 whereby the 
customer can be presented with varying choices such as 

50 leaving a voice message, waiting in queue, receiving a call 
back, or perhaps an e-mail, and so on. Interaction by IVR 69, 
in this instance, will preferably be via voice recognition 
technique such as is known in the art, but may also be via 
touch tone response or other known method. As previously 

55 described, the caller may elect from a number of options, 
such as to hold for a next available agent, select an auto- 
mated response such as a fax back, or perhaps a later 
agent-initiated response such as an e-mail or call back. In all 
cases, CINOS seamlessly processes and executes the logic 

60 required to accomplish the goal of the caller in a media and 
application- independent fashion. 

DNT events are handled much the same way as described 
above for live callers. For example, an IP call may be routed 
to a digital equivalent of an IVR for interaction or queued for 

65 a next available agent, and so on. In one embodiment, IVR 
69 may be adapted to handle both COST and DNT interac- 
tion. 
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All interactions with live external media, including actual and stored in DB 79 associated with the recording of the 
text-based events whether live or not, are recorded and event. Again, the importance of the text version is that the 
stored in MIS 79 with an associated text version of the media extracted knowledge of the transaction therein is in 
stored as well, and becoming part of an overall threaded machine-operable code, allowing search and cross- 
contact history. This is accomplished in varying ways 5 referencing functions that may otherwise not be possible, 
according to existing parameters such as media type, j^^^^. ^^^^^ ^^^j processed with 
whether the event is a live call, and so on. For example, ^^ ^^^^ ^^^^ ^^^^j. ^ J. ^ ^^^.^^^ 
CINOS may execute a command directing IVR 69 to fu r u . ^ 1 i- n 
digitally re<i)rd an incoming COST call during customer disposition paths of each event. For example, bve calls 
interaction and then store the voice recording of the trans- ^^^^.^^^ ^^^^ ^^^"^ if available, if this is the 
action in MIS 79. A text version of the recording either P"^^, m the enterprise rules. E-mails are either 
created simultaneously from the voice recording via voice- ''^f^^'l'^t '^'^o "lu^ technology, or 
to-text techniques (known in the art), or created by a live ^"^^^y '^'f ^^^^ J,^ "^^''^ ^^^^ °^^>; ^^^"^^^^ 
auendant via manual annotation may be sent to and stored in f S?'^ notification. Recorded events such 
DB 79. An IPNT call arriving at routing server 29 may be f,^ ^^'^ request are stored m MIS server 79 where 
similarly recorded and stored in MIS 79 with an associated ^^""y ^^^"^^^^ ^y ^^^"^^ ^ 
text version of the interaction stored in DB 79. E-mails, ^hc use of routing and routing notification events, any 
video calls, voice mails and so on are similarly handled. For ^^^^^ ^« *o an appropriate agent based on skill, 
example, an incoming e-mail is stored in MIS server 79 or any other rule-based routing method over LAN 55. Actual 
while text from the e-mail may be extracted and stored multimedia events may be accessed from MIS server 79 at 
associated with the e-mail agent's discretion, or by rule, and text-based versions of 

The purpose of the text* version of the event is twofold. ^ «^ ^^^"^s stored in DB 79 may be mirrored and routed to 

Firstly, a complete text-based transaction history of com- ^^^^S "^'^^ notification of the mcoming event, 

munication center 17 may be compiled and reserved for later ^^^^^ services may be perforaied by CINOS such as 

access and audit. Secondly, an agent or knowledge worker ^5 responding to media requests without agent participation via 

may, in some instances, see the text version of the event at initiating automated fax responses, out-bound dialing cam- 

ihe same time that he receives routed notification of the paigns wherein recorded information is given to a customer 

event. In this way, an agent may begin mental preparation perhaps concerning an order placed by the customer, and so 

before taking a call. The text version of an event must be on. Networkmg via business or chat applications between 

machine-readable and human readable at times displayed. 30 several business partners, customers, agents, and so on, is 

Interactive media-independent viewers, part of the agent's possible wherein each entry may be stored in DB 79 as part 

client application, may be used to disseminate information of ^ discussion thread including responses of another media 

which may initially not be human readable. *ypc> perhaps initiated by a communication-center agent to 

It is important to note here that the text-based version of one of the participants during the discussion, 

an event may or may not be a complete and verbatim 35 ^ ^ general rule, full multimedia storage is done in a 

rendition of an actual media event. For example, an e-mail mass storage server, and linked by cross-indexing to the 

may contain many documents each having many pages of database. Depending on the business model, full text or only 

text. Therefore, the text-based version of a particular e-mail partial annotation is stored in the database, or a mix thcrof, 

event may simply contain the name and particulars regard- e.g by media type. 

ing the author, a purchase order, and a list of the enclosed 40 In addition to supporting a wide variety of applications 
documents by title, and basic content or memo as well as a and protocol, CINOS is provided with the tools for building 
possible manual annotation. The attachments to the e-mail media-independent self-help wizards that are adapted for 
may be sU)red separately, and be also cross-indexed and problem solving and reduction. Similarly, external and inter- 
retrievable. Seeing the purchase order when the event is nal interaction media viewers are provided and adapted to 
routed to an agent desktop tells the agent that this e-mail is 45 support any media of choice. 

important. CINOS uses object modeling and linking techniques that 
A fax, stored originally as a bit-mapped document, may are known in the art to effect much of it's goal of presenting 
be converted to text in the system via optical recognition a seamless customer interaction with an enterprise agent or 
(OCR) technique wherein sometimes only certain content knowledge worker operating in a communication center 
such as the authors contact information, basic intent of the 50 such as center 17. For example, an interaction object model 
fax, and perhaps special numbers or codes contained in the (TOM) represents a transcript of all interaction history stored 
original fax are recorded in a text version 79, sometimes the in DB 79 and provides an audit trail of the slate of trans- 
whole text is OCR'd, while the original fax is stored in it's actions of all interactions. An interaction process model 
entirety in DB 79. Such codes or numbers that are specifi- (IPM) controls how events are handled within the operating 
cally parsed from actual media may be part of a unique 55 system. 

coding system set up by the enterprise whereby customers An additional set of models handle how agents receive 
are directed to include such codes or numbers with their their routed media such as via traditional push model, 
orders, service requests, and so on. blended push model, publish and subscribe model, or inter- 
Parsing text messages is accomplished via a text-analyzer nipt model. Prioritizing interaction events may also be 
known to the inventor. In other non-text media types, such 60 accomplished through varying the push theme or scheme, 
as video or graphics, descriptive notes may be taken via live For example, traditional push technology for e-mail means 
attendant and stored in DB 79 as previously mentioned. that only e-mail (media type) is being worked on by an 
Voice recognition technology may also be used in a case of agent. By blending the push model with a publish and 
recorded sound or video with sound. All transactions regard- subscribe model, the interrupt model is created wherein the 
less of media type are thus recorded and stored according to 65 agent may subscribe to various routed media such as answer- 
enterprise rules with at least a meaningful part of the content ing phones, and responding to faxes, but may be interrupted 
if not all of the content of such transactions converted to text for an important interaction of another media type such as 
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e-mail and so on. In this way an agent's time may be utilized A third category termed interaction routing 93 comprises 

according to enterprise rules within an automated environ- various processes associated with the presentation of the 

ment. interaction to agents, service persons, knowledge workers, 

Outbound campaigns may be configured according to business partners, customers and the like, that is, all trans- 
enterprise rules and media preference using a single rule-set 5 action partners. Category 93 covers queuing, skill-based 

knowledge-base. This single set of outbound tools can be routing, automated treatment, workflow models, and so on. 

used to initiate customer dialog via predictive dialing, e-maU Internal media layer 87 comprises an agent desktop 

push, automated recorded messages, and so on. interface not shown in FIG. 1, but described in more detail 

It will be apparent to those with skiU in the art that below. Both external layer 83 and internal layer 87 contain 
common object modeling (COM) can be used to create the required tools for enabling media and application- 
virtu ally any type of model for any type of enterprise independent interfacing such as previously mentioned self- 
situation. It is the intention of the inventor to provide the help wizards, media viewers, and other controls as pre- 
applicable control codes known in the art for building scribed via enterprise rules. 

process and object models and enabling the linking and Internal media layer 87 provides an agent with, among 
interaction between the models. As previously described, it ■'^ other options, information about the customer or contact, 

is partly the fact that CINOS uses these various models and information about current or historical business processes, 

knowledge bases to achieve desired interaction that sets it information about current interactions and their relationship 

above current-art systems. The inventor knows of no such to business processes, and a knowledge -base to guide the 

network interfacing operating system that is based on the agent or knowledge worker with interaction response and 

above described technology. workflow. An agent a, and agent b, and a knowledge worker 

QNOS may be implemented in a number of different c are shown herein interacting with the system as illustrated 

topologies. For example, CINOS may be implemented as a via bi-directional arrows. The skiUed artisan will recognize 

centralized topology with one communication center as these are merely examples, and there may be many more 

shown here in FIG. 1, a distributed topology wherein a such persons, and interactions in some instances may be 

single communication center may span multiple physical routed to machines for response. 

locations, a segmented communication center wherein a It wiU be apparent to one with skill in the art that the 

single pool of agents services more than one company or multi-tiered architecture of CINOS such as is illustrated 

customer base, or a wide communication network wherein a herein may comprise many more or differing steps or 

plurality of communication centers such as center 17 coop- processes without departing from the spirit and scope of the 

eratively service a common pool of customers or a customer present invention. 

base. Enterprises involved in commerce such as large finan- FIG. 3 is a flow chart illustrating basic steps performed by 
cial institutions hosting many geographically separate com- the interaction operating system of FIG. 2 related to com- 
munication centers may build their entire networking system pleting a transaction between a customer and an agent, 
using CINOS architecture in standardized and distributed wherein the transaction is initiated by the customer. Similar 
fashion. There is no limitation to the type of enterprise that steps may be accomplished in the opposite direction for 
may use CINOS as it may be tooled to accommodate communications initiated by an agent, as the system is 
virtually any network architecture linked to a communica- bi-directional, but the present example will serve to teach the 
tion center having DNT capability. inventive aspects of the system. In step 95, an incoming 
It will also be apparent to one with skill in the art that transaction, such as a live call, an e-mail, etc., is received at 
CINOS routines according to various embodiments of the the appropriate CTI switch (COST) or routing server (DNT) 
present invention may be included and implemented at the in a CINOS communication center such as center 17. In step 
network level without departing from the spirit and scope of 97, customer and media type are identified and interaction 
the present invention such as in processor 61, and IVR 59 in proceeds. 

PSTN 13, or in routing node 21 in WAN 11. 45 All transactions, whether live calls, such as video calls, 

FIG. 2 is a block diagram illustrating basic layers of the DNT calls and COST calls, or text -based documents, such as 

network operating system according to an embodiment of e-mails, are recorded and stored in one or more mass storage 

the present invention. As previously described with refer- devices handled by one or more database applications. This 

ence to FIG. 1, CINOS comprises three basic operating may be taken as server 79 of FIG. 1, although the diagram 
layers. They are an external media layer 83, a workflow 50 of FIG. 1 is exemplary. 

layer 85, and an internal media layer 87. External media A principle object of the invention is to extract maximum 

layer 83 interfaces directly with the customers or business information from every transaction for building a knowledge 

contacts or partners as illustrated via customers a and b, and base that can be used for dynamic management and future 

business contact c. The bi-directional arrows beneath each of analysis and development. This is done primarily by data 
the above mentioned participants illustrate interactive par- 55 mining, which is applicable to machine-operable code, thaf 

ticipation with CINOS on the customer side. is text. Because of the nature of the extraction, there is a 

External media layer 83 may, in one embodiment, be a difference in the way live calls and text-based media is 

multifaceted, web-based self-help interface providing news handled. 

information and a host of other sen^ices that may be per- Discrimination as to the text nature of the media is made 
sonalized by the customer. In many respects, extemal media 60 at step 99. If the media chosen by the customer is already 

layer 83 in this embodiment is similar to a web browser text-based, then the transaction is recorded as received 

Workflow layer 85 comprises 3 basic function categories (101), and a data mining appUcation extracts important 

beginning with a content analysis category 89 wherein information in step 103 and stores it in the knowledge base, 

textual analysis, voice analysis, IVR interaction, recording The distinct portions and versions of the transaction, such as 
andstoringtakesplace. A next category is context resolution 65 the originally recorded version and any extracted data are 

91. Context resolution involves customer identification, related to one another and to other knowledge previously 

business process binding, preparation for routing, and so on. stored, and become part of a threaded interaction history 
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associated with an ongoing interaction and ultimately of an Internet may communicate with client 119 as it intended to 

overall contact history. support all existing and known communication protocols. 

If the media chosen by the customer is determined in step A windows client 123 is provided to seamlessly integrate 

99 to be a live interaction such as a COST or IPNT call, then existing applications on the agent's PC to network appUca- 

the existing knowledge base is accessed at step 107, and the S tions and processes. This may be implemented via a desktop 

call is routed to the best fit agent. This may, of course, be iool-kit 125 that contains all of the required controls for 

done in a number of ways, such as an ADC, skiU-based building, mtegratmg and customizing the mterfacc. 

routing as known to the inventors, transfer to an IVR for A business-logic layer comprises business object models 

automatic processing, and so on, as may be dictated by ^^9, hereinafter termed busmess objects 129, representing 

enterprise rules. If routing is to an agent, customer infor- lO ^o^^acts, mteractions, knowledge-bases, events, routing 

mation may be retrieved from CIS server 57 (FIG. 1) and P^o^^^s. j^^^ other system routines^ Integration and mter- 

^ , ^, J • * • . I- action of the various described desktop components with 

sent to me agent s fC, ana appropriate scripts may De ^^^^ 

logics is accomplished via common object mode line 

provided to guide an agent m mteracting with the caller. (^OM) which is known in the art and available to the 

In step 109 the actual transaction is recorded as it takes inventor. Desktop to CTI integration is accomplished via 

place, which, in the case of live calls, may be a video or an controls provided or created with a CTI set of tools or tool 

audio recording or a combination of both. Preferably the kit (not shown). For example, if the enterprise desires to 

recording is digitized. blend voice and e-mail, the CTI tool kit would be used to 

In step 111, a maximal text version is prepared from the build and integrate the interface, 

actual transaction. The ability to do so depends to a degree Existing network applications such as CIS, enterprise 

on the sophistication of the system. This process may be as resource planning (ERP), Commerce, and the like interact 

simple as a person adding notes for annotation or as sophis- with various business objects using COM and may also 

ticated as a voice-to-text application preparing a full text interact with a physical database using ODBC and SQL. 

version as the transaction transpires. Customer Interface Media Window 

T . ^I'l^u X * • • • jr J * J 1." According to a preferred embodiment of the present 

In step 113 the text veBion IS mmcd for data and resulting ^ ^^^03 ^^^^ ^ customers of an enhanced 

knowledge is stared in the appropnate knowledge base for multimedia communication center, such as center 17 of FIG. 

future use, and added to overall record with appropnate ^ controlled by means of a customer-facing media 

cross-reierencing. interface, by which customers may be identified and even, 

It will be apparent to one with skill in the art that there will categorized according to numerous criteria. In some cases 

be many routines comprising various steps for performing 30 access may be controlled through subscription, or according 

different processes as may be determined by enterprise rules ^jtier qualifying criteria such as may be deemed appro- 

which may likewise vary depending on, among other ^^^^^ the enterprise. For example, if the enterprise is an 

considerations, company type, product and or service type, exclusive investment club, membership may be required, 

communication center architecture, whether or not the sys- Categorizing criteria may include demographic information 

tem architecture is centralized or distributed, and so on. The 35 g^ch as income level, credit history, or any other attribute 

embodiment taught herein is meant only as a basic example ^^at may be quantified and used to categorize a customer, 

of process functionality related to CINOS processing of an ^ enterprise-controlled access point may be defined as 

incoming event. interfacing window or portal created and maintained at a 

FIG. 4 is a block diagram illustrating agent-desktop typical customer entry point in a network as may be known 

function according to an embodiment of the present inven- 40 in the art. Such interfaces may take the form of a WEB- 

tion. An agent-desktop client 115, part of the CINOS overall based customer interface (a WEB page), an interactive voice 

architecture, enables an agent or knowledge worker to response (IVR) unit, a service control point (SCP), or some 

configure and control his or her interface to the rest of the other customer-facing system or apparatus as may be known 

system and to external media. Client 115 may be personal- art. 

ized according to a particular agents parameters. A desktop 45 por the purposes of this specification, an example of an 

interface 117 may appear and function much like a person- enterprise-controlled WEB -form access and interface win- 

alized web-browser containing many similar attributes dow is illustrated as an example for a preferred embodiment, 

related to network capabilities including full multimedia The inventor deems such an interface to be most adept in 

function, software tool kits, linking and embedding offering best-fit media options while remaining accessible to 

capability, and so on. 50 a large customer or client base. 

An HTML client application 119 oversees all of the FIG. 5 is a block diagram of a WEB-form customer 
network capability previously mentioned. In this embodi- interface according to an embodiment of the present inven- 
ment for example, HTML client 119 communicates with an tion. WEB form 133, hereinafter termed access window 133, 
Internet information server 121 using HTTP protocol which is provided to be a part of an enterprise's WEB page which 
is standard. Client 119, if provided minimally, may be used 55 may be accessed through Internet connection and 
in conjunction with an Internet browser for ftiU multimedia navigation, as is known in the art. Widow 133 is part of the 
function. In some embodiments, it may be maximally pro- CINOS software architecture described above, and repre- 
vided to be a fully featured client with fill web browser sents the initiation of any customer interaction with the 
function. For example, an agent may create and edit web hosting enterprise, A WEB counter 143 is provided and 
forms, web pages, embed controls into such web-based 60 records the number of visits to window 133. 
forms or pages to provide certain customer interaction Window 133 is built and edited using COM codes avail- 
mechanisms in addition to having a fully functional navi- able to the inventor and typically found in tool kits adapted 
gation tool at his disposal. for the purpose of creating interactive displays on a WEB 

In another embodiment. Server 121 may be a server on a page. Such a tool kit may be located on an agent's desktop, 

private network or corporate WAN instead of an Internet 65 perhaps part of an agent's HTML client such as client 119 

server. In a preferred embodiment, however, any number of of FIG. 4. In one embodiment, it may be part of a system 

servers on the Internet and/or linked to a WAN other than the administrator's tool kit. 
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Window 133 contains interactive options directed at vari- Finally, the client may be asked to create a password for 

ous categories and functions. For example, a new client the purpose of accessing CINOS. A section 141 is provided 

section 135 contains interactive options related to adding a containing a network log-in option along with download 

new client to the active customer base of the enterprise. A sections for obtaining permanent and or temporary software 

customer service section 137 contains interactive options 5 as may be desired or needed, or, in some cases, required for 

presented to existing clients needing service. A new order i^e client to access certain services, view certain content, 
section 139 contains interactive options presented to existing 

cUents wishing to do new business. ^^^^^^^ ^37 ^edia options for clients seeking 
Each offered mteractive option is an embedded executable customer service from the enterprise. These options are, in 
fnTn^^^'l appropriate hnks to other system areas ^ ^^^^^^^ embodiment, presented in a customized or per- 
of CINOS such as may be relevant to the immediate inter- , , ♦u- *u 1*^ a 111 
action such as to services offered, routing routines, database ^^"^^f ^ ^^^^^^ "^^""^ ^^''^^ s ^mdov^ 133 as was 
searching, interaction recording, and so on. ^^^^"^^^ ^t'^^^' Therefore, each client patromzmg the 
An innovative function of window 133 is to provide enterprise may access a version of wmdow 133 that differs 
front-end control of access to the enterprise by existing and 1°°^ functionahty than that of another chent. In this 
potential clients/customers. For example, as a client, contact, 15 example, service section 137 contains options for e-mail, 
or potential client interacts with the various media and chat program, fax program, a self-help wizard, and a voice 
functional options presented by the enterprise m window wizard. Other media types may be added or subtracted from 
133, he or she is being directed according to enterprise rules the client's window 133 depending on any of several crite- 
in such a way that he or she may first be qualified or not to ria. Personalization of widow 133 takes into account client 
patronize the enterprise. Secondly, the contacting person 20 mformation as stored in QNOS database 75, service-agent 
may be categorized and sorted as to type of qualified media availability and preferences, and perhaps any over- 
customer. Thirdly, the person contacting person may be riding enterprise rules. Unless and until a client is identified 
directed to pre-selected media options by the enterprise for there are typically no options presented to the client for 
various services offered including but not limited to routing continuing a transaction with the enterprise, 
live interactions, and so on. 25 For an identified client, by selecting the e-mail option, the 
In a preferred embodiment of the present invention, client's preferred e-mail program may be activated for the 
access window 133 is fully customizable, based on customer purpose of sending a message to or sohciting a reply from 
data and enterprise rules with the focus of such customiza- a service agent. By selecting chat program, the client may be 
tion directed toward benefiting the enterprise and ultimately launched into a scheduled service seminar featuring many 
the client. That is, the client's options within window 133 30 clients interacting with a service expert regarding a certain 
are pre-selected and preferred by the hosting enterprise subject. One enterprise rule regarding section 137 may be 
based in part on data about the client, details about the that there is no telephone or I-phone media option for 
client's communication equipment and software, and enter- customer service for a client in the absence of an ongoing 
prise rules and constraints. In some embodiments, the cHent project with the particular customer. In this sense an ongoing 
may aid in customizing window 133. However, as it is 35 project includes any unfinished business that the client is 
desired by the enterprise to provide service in a cost- involved in with the enterprise. 

effective manner, the client will be presented with options as Self-help wizards and voice wizards as illustrated in 

preferred by the enterprise in most cases. section 137 may be offered to help a client resolve an issue 

To further illustrate, refer now to new client section 135. without taxing further resource. Such wizards may be cus- 

If window 133 is part of the enterprise WEB page, as is the 4q tomized based on a client's recorded data, perhaps confirm- 

case with this example, there will be a variety of visitors ing past interactions, providing account or order status, and 

which may or may not be pre-qualified by the enterprise. so on. In some embodiments, selecting an option might avail 

Therefore, an interested party would begin (and be restricted several additional options. For example, selecting chat pro- 

to) taking a new client survey, illustrated as one of the gram may avail three possible chat programs to choose from 

options in section 135. If the enterprise rules require this as 45 with different schedules, content, and functionality attrib- 

a first step, then the other options may be enabled only upon uted to each individual program. 

completion of the survey. By choosing new client survey, a New order section 139 in this example contains various 

second window may contain various survey options such as options adapted to facilitate placing orders. The options as 

via e-mail, interactive voice recording, type and send illustrated herein include, but are not limited to, I-phone, call 

method, or the like. 50 back, promotional models, video presentations, an on-line 

Information taken in the client survey is recorded and viewer, and an order wizard. Interaction is the same as was 

entered into a CINOS database such as DB 75 of FIG. 1. stated with regards to section 137. For example, selecting 

Such information may also be compared against enterprise promotional models, accesses a database containing the 

rules or constraints, and other known information as may be current promotional information and features of products 

available to the enterprise. Assuming the client is now ss which may be viewed interactively by the client using an 

recognized by the enterprise, the client's media hardware on-line viewer offered as one of the functional options (tool), 

and telephony information may be recorded for future The options presented in the New Orders section may also 

interaction purposes. Such information may include the be customized according to client identity, demographics, 

client's personal computer parameters including modem transaction history, and enterprise rules, 

type, Internet connection type, computer platform type, type 60 On-line viewers may enable the client to view documents 

of Internet phone application installed, etc. Similarly, COST that are not supported on his computer platform. Selecting 

telephone parameters may be recorded, such as personal video presentation may avail several types of videos for 

phone number, business phone number, cellular phone viewing, such that the client may choose one. If the client 

number, forwarding numbers, and so on. Such data will does not have a viewer installed on his computer which will 

influence latter customization of his personal window 133 65 support the offered video, perhaps the on-line viewer may 

for the particular client including the typesof media that will play the video, or (he client could download a temporary 

be offered. viewer from section 141, etc. Selecting call back may bring 
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Up a second array of media choices made available by the event that CINOS remembers the client's assigned 

enterprise for receiving a reply interaction from an agent. password, or perhaps typing the passvi^ord or other code may 

By providing a controlled interface window such as still be required for security reasons. At the time of log-in, 

window 133 the enterprise may control routing and inter- window 133 is presented in personahzed fashion according 

action right from the beginning of customer contact. 5 to client data and enterprise rules in step 161. In step 163, 

Through the innovative method of linking and reporting to interaction between an enterprise entity and the client begins 

other CINOS functions, and repositories, much real-time with a media type that is offered by the enterprise and 

personalization of window 133 according to enterprise rules selected by the client. An enterprise entity, as immediately 

and customer parameters may be made automatically. For described above, is herein defined as an agent, knowledge 

example, if a client's history indicates a propensity toward worker, service person, or any other live attendant, as well 

frequent buying, an I-phone option may be presented in as any entity constituting an automated response action such 

customer service section 137 in his window 133 immedi- as an automated fax, an IVR, automated file downloads, etc. 

ately after such a determination so that he may get direct At step 148, if it is determined that the visitor is new, then 

customer service at all times, a new client survey is conducted in step 149. Step 149 will 

Certain media options, as described above, may be determine if the new visitor is a client or business contact via 

afforded a certain priority over one another regarding inter- the survey process. As described with reference to FIG. 6, 

action with the enterprise. For example, a VIP client may the client survey may be conducted using a variety of known 

have live interactive media choices offered in window 133 techniques and media. Presuming that a new visitor qualifies 

such as I-phone, call back to COST phone, video phone, etc, as a client or business contact in step 149, he or she may be 

A client loiown for infrequent contact or troublesome inter- asked to create a password in order to provide access to 

active history may be limited to text-based interaction such 20 CINOS. In step 153, the client's appropriate communication 

as c-mail and so on. and system parameters are recorded for future reference and 

As an integral part of CINOS functionality, window 133 for use in customizing window 133. 
acts as a portal through which existing and potential clients At step 155, a client instance of CINOS, or perhaps 
may be screened, categorized and routed according to enter- another enabling application, may be presented for down- 
prise rules. Customer interfaces such as window 133 may be 25 load by the client. In some embodiments, there may be no 
provided at various locations on a WAN such as the Internet required software for download. Therefore, step 155 may be 
without departing from the spirit and scope of the present considered optional in this regard. In step 157, the new client 
invention. Such portals may exist in different geographic may log-in to the network system and begin interaction, 
regions, and may be created for differing customer bases Because the client, in this case, is accessing the system for 
such as one for Latin America, and one for the pacific rim, 30 the first time, the steps wherein he would obtain a custom- 
and so on. Instances of CINOS routine may be distributed ized window and begin interaction with an enterprise entity 
widely over a network. are not shown as intermediate configuration of media 

Although the example provided herein is of a WEB form, choices, product preferences, and the like, may still be 

it will be apparent to one with skill in the art that a CTI required before a customized interface may be presented. In 

counterpart may be created for the COST telephony net- 35 one embodiment, the client may not see a customized 

work. Such a case may be a CINOS enhanced IVR at an SCP window until the next time he or she attempts to access the 

or customer access point in the COST network. network. 

QNOS, as previously described, optimizes customer/ Steps 165, 167, and 169 for an existing business contact 
agent interaction in a manner which is economical and cost as determined in step 148 are similar to steps 159, 161, and 
efiScient to both the enterprise and the patronizing client. The 40 163 for an existing client although the rules for interaction 
customer interfacing window as taught herein with regards such as media used, personnel involved and so forth will be 
to FIG. 5 is innovative in that it is a fully customizable portal different. For example, in step 167 an existing business 
that facilities seamless integration between clients and enter- contact may be offered the option of using a network- 
prise agents according to enterprise rules. Further innovation collaboration program wherein I-phone, file sharing, video 
is evident in that client data is fully and seamlessly intc- 45 conferencing and the like are inherent to that one applica- 
grated with CINOS intelligence and enterprise rules regard- tion. 

ing routing of interactions and other constraints or limita- It will be appreciated that there are many possible logic 

tions that are programmed into the system. In effect, logic sequences or steps that may be followed in interfacing and 

from the front end, or customer side, to the back end or agent enabling interaction between a client and an entciprise entity 

side is linked and accessible to all appropriate CINOS 50 without departing from the spirit and scope of the present 

routines which include applicable CTT CINOS routines. The invention. FIG. 6 presents just one possible example of 

various customer interfacing logic is are explained more many. 

finally below in a series of process logic steps in a flow chart. It will be apparent to one with skiU in the art that the rules 

FIG. 6 is a flow chart illustrating media-presentation and governing the types of media offered to clients may be based 

customer-interface logic steps according to an embodiment 55 on a combination of variables such as may be decided upon 

of the present invention. In step 145, a visitor registers at an by the enterprise without departing from the spirit and scope 

enterprise's WEB page. The visitor is identified according to of the present invention. Likewise, offered media types may 

enterprise rules in step 147. In step 148 CINOS determines be added or withheld from a client over a period of time 

the current status of the visitor after searching known client based on such variables. Moreover, such additions or sub- 

and contact data records. For example, the visitor may be a 60 tractions of media availability with regards to customer 

potential new client, an existing client, or an existing busi- interface window 133 may be automated and based on 

ness contact. Although not specifically illustrated, a potential calculated variables. 

or new-business-clienl is not typically logically separated In one embodiment, a client may add or subtract media 

from a potential new-client until further process ensues in choices if desired, however, the enterprise may reserve the 

step 149 with regards to qualification via survey. 65 right not to engage such media if added by a client. 

If the visitor wishes to be a client, he may log-in to the In one embodiment, special application-independent 

network system in step 159. Log-in may be automatic in the media viewers such as the viewer offered in section 139 of 
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window 133 of FIG. 5, are offered to clients and possessed 
by agents so that initial illegible information may be made 
human readable regardless of the authoring application used 
by the agent or the client in the process of interaction. 
Rules-Based Storage and Threading of Multimedia Interac- 
tions 

In a preferred embodiment of the present invention, all 
CINOS controlled interactions with customers or business 
contacts are recorded and stored in a contact history com- 
prising a MIS database and a text database such as were 
described with reference to copending application P3313PA, 
and described above. That is, actual multimedia interactions 
are recorded to one database or to a section of one database 
supporting all multimedia types used in the communication 
center, and text -based versions are stored in another data- 
base or portion of the same database. All of the actual 
recorded transactions and text versions are related as a 
threaded contact history which may be separate from or part 
of the same database as will be further explained below. 

FIG. 7 is an exemplary overview of a multimedia- 
interaction storage system within a communication center 
according to an embodiment of the present invention. A 
system architecture 171 is illustrated solely for the purpose 
of providing just one of many possible architectures in 
which the methods and apparatus of the invention may be 
practiced. Architecture 171, which in a preferred embodi- 
ment comprises both conventional and DNT apparatus, is 
exemplary of an architecture that could facilitate CINOS 
according to an embodiment of the present invention such as 
is also the case of FIG. 1 

At the heart of the storage system is a mass-storage 
repository 187 adapted to store multimedia interactions as 
well as text-based related files. Repository 187 may utilize 
any form of digital storage technology known in the art such 
as Raid- Array, Optical Storage, and so on. The storage 
capacity of repository 187 will depend directly on it's 
implementation with regard to the size of the communica- 
tion center and predicted amount of data that will be stored 
and kept by the system. 

In this example, repository 187 is divided logically into 
two sections. One section, multimedia information system 
(MIS) 189, is responsible for housing all multimedia inter- 
actions defined as media that is not text-based such as audio, 
video, and graphics-based media. All multimedia interac- 
tions are stored in MIS 189 whether incoming, outgoing, or 
internal. A second section, herein referred to as text section 
191 is responsible for all text-based interactions as well as 
text versions related to non-text files. Sections 191 and 189 
of repository 187 are analogous to MIS 79 and DB 75 of 
FIG. 3. 

Repository 187 is connected to a communication-center 
local area network (LAN) 195. Repository 187 is accessible 
via LAN 195 to authorized personnel within a communica- 
tion center such as agents, knowledge workers, or the like, 
and may, in some instances, also be made available to clients 
communicating with the call center. A network router (RTN) 
175 is shown connected to LAN 195 via network connection 
203. In this example, network router 175 is the first point 
within a communication center wherein DNT media aaives. 
Network router 175 is exemplary of many types of routers 
that may be used to route data over LAN 195. An Intemet- 
protocol-network-tclephony (IPNT) switch 176 is connected 
to network router 175 via data link as is known in the art. 
IPNT switch 176 further routes or distributes live IPNT calls 
that do not require routing to a live agent. IPNT calls that are 
routed to live agents are sent over connection 203 to LAN 
195 where they reach agent PCA^DU's (not shown) or 
DNT-capable phones (not shown) as illustrated via direc- 
tional arrows. 
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An object of the present invention is to record all multi- 
media interactions and store them in MIS 189. A further 
object of the present invention is to similarly record text 
versions of and text files related to all multimedia interac- 

5 tions and to store them in text-based section 191. For the 
purpose of the present invention, a text version of a non-text 
file is defined as a sufficient text rendition or description of 
a corresponding multimedia interaction. Still another object 
of the present invention is to provide an innovative mecha- 

10 nism wherein authorized persons may access any particular 
block of text and if desired, call up the actual media to which 
the text relates. 

More detail regarding the order and manipulation of 
repository 187 is described further below. 

15 Creating text-based versions of live multimedia interac- 
tions may, in some cases, be accomplished via an automated 
method. For example, a digital voice attendant 197 is 
provided and linked to IPNT switch 176. Digital voice 
attendant 197 may be of the form of a DNT-capable IVR or 

20 other digital voice-response mechanism as may be known in 
the art. Such automated attendants may interact with a voice 
caller instead of requiring a live agent. A speech to text 
converter 199 is provided and linked to voice attendant 197. 
As digital voice attendant 197 interacts with a caller, speech 

25 to text converter 199 uses voice recognition technology to 
convert the audio speech to text. Such text may then be 
stored automatically into text section 191 and related to the 
also-recorded audio data. 
It will be apparent to one with skill in the art that as speech 

30 recognition technologies are further improved over their 
current state, which is adequate for many implementations, 
reliable text versions of audio transactions are not only 
possible but practical. Such speech to text conversions are 
used here only for the convenience of automation wherein 

35 no live attendant is needed to transcribe such audio data. The 
inventor is familiar with such converters as used in the 
CINOS system according to a preferred embodiment. Such 
converters provide convenience in the practice of the present 
invention but are not specifically required to achieve the 

40 objects of the present invention. 

Manual transcription may also be used to convert audio/ 
video to text or code that may then be entered into text 
section 191. For example, a live attendant 201 is shown 
connected to LAN 195. Attendant 201, in this case, may be 

45 given the responsibility of transcribing audio files from 
speech to text and annotating video or graphics files for the 
purpose of creating text files related to the non-text data. 
One or more live attendants such as attendant 201 may be 
provided for this purpose. Some media arriving at a com- 

50 munication center such as the one represented via architec- 
ture 171 will already be text-based and therefore require no 
conversion or annotation. Short e-mails, Faxes, word 
documents, and so on are part of this media category. 
An automated services system 193 is illustrated as having 

55 a direct connection to section 191 of the data repository. 
System 193 is provided for certain text-based interactions, 
as described above, wherein a complete text record of the 
interaction may be mirrored, or otherwise created and stored 
into text section 191. Such automated services may include 

60 but are not limited to automated e-mail and fax systems. For 
example, a fax may be sent and mirrored into section 191 or, 
perhaps recreated using an optical character recognition 
(OCR) technique and then entered. Physical text-documents 
such as legal papers and the like, may be automatically 

65 scanned into text section 191 before they are sent to clients. 
There are many possible automated techniques for entering 
text files into a database. Such methods described with 
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regards to automated services 193 are a convenience in access text data and ability cross-reference the data to actual 

practicing the present invention but are not specifically recorded multimedia interactions which may be displayed 

required to achieve the objects of the present invention. and played back. 

With respect to the dual capability (COST/DNT) of FIG. 8 is an illustration of a relational diagram as might 

architecture 171, a central telephony switch 173 is provided 5 be displayed on a display monitor, representing entities 

to be a first destination for COST calls arriving from, for stored in the databases described. The blocks of FIG. 8 

example, a PSTN network. Switch 173 may be a PBX, ACD, illustrate threaded text-blocks and their relationship to stored 

or another known type of telephony switch. Internal COST multimedia according to an embodiment of the present 

wiring 182 connects telephony switch 173 to agent's indi- invention. Repository 187 comprises section 191 and 189 as 

vidual telephones (not shown). Switch 173 is enhanced via lO illustrated in FIG. 7. Section 191 contains text versions of 

a processor 179 running an instance of T-server and an interactions that are related by such as chronology, issue, 

instance of Stat-server, which are software enhancements participants, company affiliation, and the like. The text 

known to the inventor and have been previously described. documents and versions of non-text files, represented in this 

Such enhancements provide CTI applications, such as intel- case by icons, are shown related by serial position. For the 

Hgent routing, but are not specifically required to practice 15 sake of clarity regarding the innovative threading according 

the present invention. CINOS as previously described is to an embodiment of the present invention, a brief descrip- 

adapted to be integrated with such software when present in tion of prior art threading follows. 

a CINOS enhanced communication-center. Threaded dialog as is known in prior art involves a system 

An intelligent peripheral in the form of a COST IVR 177 of strings or threads that are identified as being inherent to 

is provided for the purpose of interacting with callers 20 a single entity or subject matter wherein the dialog 

seeking information and the like who do not require con- (questions and replies) is about that subject or about a 

nection to a live agent. IVR technology may comprise voice question or subject that an entity has brought forth. A 

response, touch tone interaction, or a combination of these threaded dialog may be finite dialog (is closed at some point) 

technologies. IVR 177 is linked to processor 179 and also to or it may be ongoing. Typically, a thread, which connects or 

automated services 193. An example of an IVR interaction 25 associates the pieces of dialog, contains all of the dialog in 

may be the presentation to a caller of options for using an the order that it happened such as in chronological order, 

automated service such as those described above, or perhaps Threading may be implemented based on other criteria as 

waiting for a five agent. A may be appropriate for a particular situation or by particular 

A Cn to DNT interface 181 is provided for the purpose rules, 

of converting COST interactions to digital mode compatible 30 As previously described with reference to the background 

with DNT so as to be adapted for digital storage and section, prior art threading techniques are confined to text 

interaction according to QNOS functionality and enterprise such as with an on-line message board or the like. The 

business rules as described above. Interface 181 is not inventor knows of no system that supports full multimedia 

specifically required to practice the present invention so long interaction. The innovative implementation taught below 

as appropriate application programming interfaces (API's) 35 integrates the text-based thread with stored multimedia 

are provided for equipment that interfaces with CINOS. interactions such that one may interact with the thread and 

Bi-directional arrows illustrated between interface 181 and access various stored media associated with the thread. 

IVR 177 represent the ability to route interactions in either Referring again to FIG. 8, a customer 205 is illustrated as 

direction. COST to DNT conversion may be accomplished having two threads. They are issue I and issue II. Customer 

in IVR 177 in addition to or in place of interface 181. The 40 205 has an assigned number XX — XX that identifies him or 

connection architecture presented herein is exemplary only. her with respect to the CINOS system. Issues I and n may 

A speech to text converter 185 is provided for converting comprise sales dialog, purchasing dialog, or any other type 

audio from the CTI side to text for entering into text section or purposed dialog as may be generic to the hosting enter- 

191 as was taught with regards to converter 199 on the DNT prise. Customer 205 may well be a business contact, or even 

side. Actual recorded media interactions are illustrated 45 an internal agent practicing dialog with a supervisor or the 

entering MIS 189 after text versions are rendered and like. 

entered into section 191, however, this is not required. In A scries of icons a-d represent the type of media stored 

some instances text versions of multimedia interactions may for each text block (text not shown). For example, issue I 

be rendered after the interaction is stored. There is no comprises first an e-mail text followed by a fax text, WEB 

limitation regarding sequence. It is sufficient to say that 50 text, and V-phone text. In this case, a time stamp or other 

converters 185 and 199 are capable of real-time conversion known method may be used to insure that each text block is 

and entry. in order. Icons a-d are interactive pointers or links to the 

Server 183 shown connected to LAN 195 is adapted to actual media interactions that they represent. That is, the first 

host a CINOS MGR. (operating system) application which block of e-mail text is associated with an interactive icon, in 

provides control and organization with regard to various 55 this case icon a. By clicking on icon a with a pointer device, 

functions provided by the CINOS system as a whole. The the actual e-mail may be accessed and viewed. In an 

storage architecture represented herein by element 171, and alternative aspect, not only the actual transaction may be 

all it encompasses in this embodiment, is meant only to be presented to a user for review, but related files may also be 

an example architecture as may be dedicated to the storage listed or otherwise presented for selection and review, 

and organization of communication-center data according to 60 A logical link 207 represents cross-referencing capability 

enterprise rules. between sections 191 and 189. Dialog may be threaded 

A unique method termed multimedia threading by the according to a wide variety of business rules. For example, 

inventor is tised in a preferred embodiment of the present a thread or string may represent dialog about a customer, 

invention for relating each multimedia interaction whether product, agent, group of agents, group of customers, and so 

incoming to, out going from, or internal to the system, such 65 on. An identifier is assigned to an entity and to all the 

as between an agent and a supervisor. This innovative communication events to or from that entity, or those in 

process allows agents or other authorized personnel to which the entity may have been involved such as a group 
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discussion or chat. In this way all interactions may be to be recorded is identified. Identifiers may include special 

organized and stored accordingly. passwords or codes for identifying the contacts involved 

In one embodiment, keyboard commands could be used to with the interaction. The media type of the interaction is 

cross-reference to actual media instead of icons. In another identified in step 211. If the media type is already text-based, 

embodiment, text versions of actual media are fully view- S as confirmed in step 213, then the interaction is prepared for 

able with the text itself appearing in interactive form where- entry into a database such as section 191 of FIG. 8. Prcpa- 

upon a double click may call up the associated media and so ration may include such automated processes as scanning, 

on. There arc many variations within the scope of the mirroring, file conversions, and so on. Manual annotation 

invention. via live attendants such as attendant 201 of FIG. 7 may also 

Although actual recorded media interactions are, in this lo be performed. In step 223, the text interaction is entered into 

embodiment, stored in MIS 189, there does not have to be section 191 of repository 187 and takes it's place along the 

two separate databases (one for text and one for actual associated dialog thread according to enterprise rules, 
media). All data may reside in one database and be sectioned If the interaction is of the form of non-text media as 

in storage. For example, one click on the customer name identified in step 211, then the MIS section of repository 

may bring up text only, while a double click on the text 15 187, or section 189, is notified to accept the input. At step 

brings up the associated media. 219, the non-text interaction is recorded into section 189 of 

In MIS 189, recorded multimedia interactions are rep re- repository 187. This may occur in real time as the interaction 

senled by icons I-IV and VI. For example element I repre- takes place, or some point after the media interaction was 

sents all recorded Video phone interactions. Element II recorded, 

represents all e-mails. Element III represents all recorded 20 In step 221, a text version of the recorded media or a 

COST interactions. Similar associations are made with text-based document related to the transaction is rendered 

respect to elements IV and VI which represent WEB inter- for storage into section 191 as part of the thread. In some 

actions and Video mails respectively. WEB interactions IV instances, as described with reference to FIG. 7, step 221 is 

may include on-fine orders, requests, information forms, automated via speech to text converters and occurs at the 

signed certificates, and so on. is same time or before the recorded multimedia interaction is 

Element V represents additional stored multimedia files entered into section 189, In other instances, text versions of 

dedicated to, for example, promoting the enterprises prod- multimedia interactions may be rendered after the recorded 

ucts or services. Promotional files V may contain files of the interaction is stored. A live attendant such as attendant 201 

form of any enterprise supported multimedia. These files of FIG. 7 may be assigned to parse video and or audio for 

may be tools that can be sent to clients upon request or 30 applicable text. Such parsed text is entered into section 191 

perhaps periodically. and takes it's, place along the thread as was described above. 

Referring again to section 191, element b located on the In all cases, an identifying medium is used to assign 
thread labeled issue I represents text from a fax. Because a portions of an ongoing dialog to the proper location along a 
fax is text-based and not a multimedia interaction, there is no thread as well as provide identification to actual recorded 
corresponding media event associated with it. However, the 35 media for cross-referencing such as may occur during a 
fax is threaded into the dialog according to, in this case, system audit or contact review. Further, the appropriate 
chronological order. A short example of a proposed dialog icons and or links are created and associated to entered text 
concerning issue I follows. wherein actual multimedia may be cross-referenced in inter- 
Element a represents an e-mail sent by customer 205 to active fashion. Hence, the type of media may be readily 
the enterprise requesting pricing information. An enterprise 40 identified by an auditing or reviewing agent simply by 
agent responds with a fax (b) to customer 205 containing the browsing the threaded text with accessibifity to the recorded 
requested information. Customer 205 then places an on-line events made by interactive method such as clicking an icon 
order (element c) along with a request for confirmation via with a pointer device as was previously described.' As an 
video phone (element d). Issue I may be closed at this point. additional benefit all of the threaded dialog, whether text 
Issue II may represent a threaded dialog concerning com- 45 based or not, is rendered in a form Uiat data mining may be 
pany service with regards to the customer order of issue I, used to create many useful relationships and to derive much 
or perhaps an agent-to-manufacturcr dialog regarding how useful information from the stored data, 
the order was handled with respect to issue I. It will be apparent to one with skill in the art that the order 
In accordance with CINOS functionality as previously and specific function of logical steps as taught herein may 
taught in descriptions above, data may be mined from 50 vary according to the type of enterprise, existing enterprise 
repository 187 for the purpose of enhancing service to rules, and so on. For example, instead of threaded dialogs 
customer 205. Mined data may be used to affect routing of being inherent to a specific customer with the dialog being 
interactions, product promotions or advertisements that may about the customers interactions, it may be specific to a 
be sent to customer 205. In some cases, mined data may particular agent with the dialog about the agents activities, 
effect new dialog with a customer or business contact 55 Such differences in thread assignment may be incorporated 
resulting in new thread additions, A complete contact history into one rules-based repository, 
with interactive linking to actual recorded media enables the Interactive Multimedia Viewers and Applications 
enterprise to resolve disputes more easily, better service the In a preferred embodiment of the present invention, 
customer, and enhance profitability for the enterprise. CINOS users comprising such as customers, agents, and 
FIG. 9 is a process flow chart illustrating logical steps 60 business associates are provided with innovative multimedia 
taken when building a threaded multimedia contact-history apptications that are containers for dedicated multimedia 
of communication-center interactions according to an viewers enabling a particular user to perform a dedicated 
embodiment of the present invention. Logical process steps function or functions including gaining access to and view- 
as illustrated herein are meant to represent just one of many ing media from selected areas of CINOS data storage, 
sequences which may be implemented when building a 65 Provision of such applications allows any objective to be 
multimedia-threaded contact-history. Actual steps will gained regarding virtually any aspect of the enterprise, 
depend on enterprise rules. In step 209, a current interaction These interactive applications are built from a parent appli- 
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cation or container that may contain all of the interactive 
modules that may be desired to effect a specific application 
to be presented to a user having a need for such an 
application. 

According to various embodiments of the present S 
invention, which are described below, the multimedia appli- 
cations may be adapted for such tasks as placing orders, 
previewing products, determining customer profitability, 
calculating sales volumes, reviewing agent performances, or 
any other enterprise -conceived objective. The abilities and lo 
constraints applied to these unique applications are limited 
only by the imagination, and tools available to an authorized 
programmer or worker, such as a knowledge worker, who 
creates the applications. 

FIG. 10 is a block diagram illustrating an interactive 15 
multimedia application (IMA) tool kit and a diagram of a 
created IMA application according to an embodiment of the 
present invention. An IMA tool kit 225 is provided to an 
authorized programmer, which may be a knowledge worker, 
for the purpose of creating special multimedia applications 20 
such as an IMA 239 (illustrated within tool kit) for users of 
CINOS, wherein users may access and interact with certain 
pre-selected data for the purpose of reaching decisions and 
performing certain dedicated objectives as may be defined 
by enterprise rules. IMA tool kit 225 contains executable 25 
codes or modules represented as building blocks by the 
inventors. These modules may be used by themselves for 
certain functions, or may be linked to each other to provide 
additional function in a programmed order. A good example 
of such a module would be a combination of COM codes 30 
used to buUd an interactive graphical interface (module), and 
the like. 

Among these functional modules are interactive media 
viewers (IMV's) 227 which are provided and adapted for 
viewing certain media supported by the enterprise hosting a 35 
communication center employing CINOS. Supported media 
types may include but are not limited to telephony 
(traditional or IP), interactive voice response (IVR), e-mails, 
WEB embedded interfaces or forms, faxes, chat programs, 
multiparty threaded discussions, etc. IMV's 227 are tmique 40 
in the fact that they are dedicated viewers including an 
interactive layer that enables viewing of only pre-selected 
media as defined by enterprise rules. For example, CINOS 
users may be assigned an identification code or number 
which wiU also be tagged to all of their stored interactions 45 
as described elsewhere above with reference to FIG. 9. 
These codes may be used to associate individuals with 
limitations and constraints from viewing media that is not 
part of their own contact history (for example). Other 
limitations or constraints may also be applied to IMV's 227 50 
as may be conceived and implemented by a programmer 
such as playing or viewing interactions of certain dates, 
playing or viewing interactions about certain subjects, and 
so on. An editable software layer inherent to each viewer 
enables a programmer to build such constraints into a 55 
particular viewer, and to add the edited viewer to an IMA 

Application Program Interfaces (API's) 229 are provided 
to allow a user to send obtained data or calculated results to 
connected peripheral devices or software modules or appli- 
cations as may be required for operations such as printing, 60 
faxing, sending over a network, etc. If it is desired by 
enterprise rules, for example that a customer be able to print 
certain text or graphic information obtained through IMA 
239, then the appropriate interface may be provided. 

Database Access Modules (DAM's) 231 are provided for 65 
allowing access to normally restricted databases that may be 
connected to CINOS architecture. Such databases will of 
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course include multimedia information systems (MIS), cus- 
tomer information systems (CIS), which may also include 
contact and agent associated data, external databases such as 
may be hosted by the enterprise, and so on. Constraints may 
be applied to DAM's 231 pertaining lo which and or what 
portions of certain databases may be accessed by an appli- 
cation. 

Programming language modules 233 are provided and 
adapted to facilitate the type of platform/system that an IMA 
such as IMA239 will be created for. One IMA such as IMA 
239 may be adapted to run on a variety of system types and 
platforms. System platform modules are provided as APPs 
for intended supported system/platform combinations. 
Mathematical function modules (MFM's) are provided and 
adapted to interact with CINOS databases for the purpose of 
performing pre-selected calculations such as cost averaging 
and so on. 

In this particular embodiment, IMA 239 is a finished 
application ready to be distributed. IMA 239 contains 
default display modules (not shown) for the purpose of 
enabling computer screen display on a user's system as is 
known in the art. IMA 239 may be stored in a special 
applications server (not shown) connected to the CINOS 
network either at WAN level or at the level of the hosting 
communication center. The method of distribution for 
IMA's such as IMA239 may be of the form of a WEB-based 
client presentation to a user such as in customer window 135 
of FIG. 5, for example. IMA 239 may also be of the form of 
a browser plug-in accessible via a server such as may be the 
case with a special applications server as described above. In 
other instances, such applications may be made a part of an 
agent's desktop and so on. There are many and varied 
possibilities. 

In this particular embodiment, which is exemplary only, 
IMA 239 is of the form of an interactive purchase guide for 
bulk paper products as illustrated via underlined title. IMA 
239, in this example, is logically separated into two distinct 
operations or functions. These are operation 241 and opera- 
tion 243. Operation 241 is a product preview interactive 
guide, while operation 243 is an order guide. The number of 
operations built in to an IMA such as IMA 239 will depend 
upon the intended purpose of the application according to 
enterprise rules. 

For exemplary purposes, assume that IMA 239 which is, 
in this case, a purchase guide for bulk paper products, is to 
be presented to a corporate buyer who is new on the job. 
Because he is new, he may be uncomfortable with his own 
knowledge of how much or what land of paper to buy. His 
predecessor may have a long purchase history with the 
enterprise. Therefore, he requests an IMA such as IMA 239 
that will allow him to preview products, browse the past 
purchase history of his predecessor, and perform a calcula- 
tion that averages, by month, the last years paper purchases 
made by his company. 

According to enterprise rules, IMA 239 adheres most 
closely to the buyer's request. That is. It allows for preview 
of products (241), and leads the buyer toward an order (243), 
IMA 239 may, in some instances, be designed specifically 
for one buyer if it is determined that his level of btisiness 
contribution warrants it. However, in most cases, IMA 
applications such as application 239 will be more generic 
with interchange between different users accomplished with 
some editing performed based upon the intended use of the 
application and user parameters. 

A communication center may provide a number of stan- 
dard IMA's with each IMA adapted to a different objective. 
A communication center may also provide custom-built 
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MIAs for any specific purpose, A certain amount of editing 
ability renders one IMA usable in more than one situation. 

Referring now to IMA 239, as previously described, 
operations 241 (product preview) and operation 243 (order 
guide) are available and related to purchasing bulk paper 
products. Operation 241 begins by presenting two different 
platform options from which a user may select. A platform 
A may be a Windows platfonm, and a platform B may be a 
UNIX platform. There may be more or fewer options 
regarding platforms. Similarly, applicable modules such as 
may be generic to a certain platform are installed with each 
platform. In this way, one application may be run on 
differing platforms. 

An API, labeled as such, shown logically connected 
beneath platforms A and B is illustrative of an interface for 
Unked modules depended on platform choice. A database 
module (DAM) is first logically connected to the API 
module previously described. The DAM controls which 
database or databases may be accessed by IMA 239. A 
window shown immediately beneath the DAM provides an 
edit interface wherein the author or programmer may insert 
additional constraints, such as allowing access to only 
certain database sections and so on, 

A mathematical function module (MFM) labeled as such 
is shown beneath, and logically conneaed to the edit win- 
dow. MFM is adapted to allow prescribed mathematical 
operations to be performed relative to database information 
such as cost averaging, grouping by product preference, and 
so on. Various modules as have been described herein may 
bring up additional displays on a user's computer if the 
module in question offers a choice of operation or returns 
readable results. Furthermore, standard preview modules 
(not shown) may be presented as object models and invoke 
standard viewers such as may be installed on the user's 
computer system. 

An interactive media viewer block (IMV) shown logically 
connected to MFM, allows the user to view pre-selected 
media interactions that are persistently stored in a database 
such as MIS 189 of FIG. 7. The IMV block shown may 
represent a plurality of unique IMVs or a single IMV. In this 
case three IMVs are involved, and these are represented by 
the blocks labeled TXT (text), VID (video), and AU (audio). 
Each individual IMV has an edit layer wherein a program- 
mer may apply limitations or constraints relative to viewing 
capability. In some cases the same limitations may be 
applied to all the IMVs of an application in one editing 
sequence, such as by doing one edit and copying that edit to 
other IMVs. Although there are three illustrated viewer 
modules that make up the IMV in this example, more or 
fewer viewer modules may be used depending upon the 
intended use of IMA 239 and enterprise rules. 

Although not explicitly shown, each IMV is editable 
through a software layer. In this way, a user may be limited 
to viewing certain media interactions and transactions that 
are allowed via enterprise rules. For example, TXT viewer 
may only be able to view e-mails from the user and agent in 
a specific interaction thread, but not intermittent e-mails on 
the thread that may be from agent to agent or supervisor to 
agent and so on. Because each interactor with CINOS has an 
identification, and all interactions from or to them are so 
identified, these identifiers may be used in the edit layer of 
each viewer to constrain the xiser. In this way, a user may be 
granted access to a history database and view only his 
interactions without imposing on other users who share the 
system. Likewise, agents or supervisors charged with the 
task of reviewing the activities of certain other agents may 
use applications such as IMA 239, adapted for the stated 
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purpose, and be constrained in terms of whose interactions 
(agent's) may be viewed, and so on. In this manner full use 
may be provided to specialized users without exposing 
otherwise sensitive information that is not pertinent to the 

S user or the purpose of the IMA. 

Operation 243 created to allow a user to place an order for 
products is, in this case, a logical close for the previous 
operation. A module labeled Media Options may present 
standard media choices that the enterprise accepts for plac- 

10 ing an order such as IP phone, e-mail, and so on. Aconnected 
text module (TXT) allows the user to send a quick text order 
while on-line. A send button sends a completed order to the 
enterprise. 

It will be apparent to one with skill in the art that an IMA 

15 such as IMA 239 may be programmed for virtually any 
enterprise objective without departing from the spirit and 
scope of the present invention, such as those already 
described. By utilizing pre-built modules instead of writing 
codes line-by-line, programmers may greatly increase the 

20 efficiency of application preparation and presentation to 
users. In many cases only slight editing is required to present 
a new application to a particular user. By using COM, and 
other known conventions such as Java, applications arc 
quickly assembled or modified as has been taught herein. 

25 FIG. 11 is a process flowchart illustrating logical steps for 
building an IMA for a user interacting with CINOS accord- 
ing to an embodiment of the present invention. The process 

' described below is meant to be just one example of many 
differing processes that may be implemented when building 

30 and customizing an IMA such as IMA 239 of FIG. 10. The 
process components and order of which they are assembled 
will depend largely upon the type and purpose of the 
appUcation being assembled and enterprise rules. 

In step 238, the programmer or application author opens 

35 his tool kit. Such a tool kit may be part of toolkit 125 of FIG. 
4 on a QNOS desktop interface. In step 240, the author sets 
system and platform parameters. That is, he inserts the 
proper functional modules for use of the application on 
specific platforms and or system types. For example, the 

40 author may set up one application to run on more than one 
platform or system such as IBM and Macintosh. It should be 
noted here that if more than one type of system is supported 
in one application, then the associated modules will need to 
be included as well. 

45 In step 242, the author selects a programming language 
module containing fibraries of known programming lan- 
guages and codes. As known in the art, there are different 
programming languages used for different platforms. The 
author, in addition to building with pre-assemblcd modules, 

50 or building blocks, may have to write certain functional code 
in the supported language. In a preferred embodiment, the 
author has access to these language libraries from within his 
tool kit. 

In step 245, database access module(s) (DAMs) are 
55 selected and inserted. As previously described with refer- 
ence to FIG. 10, these modules will determine which and 
what portions of databases may be accessed. In an alterna- 
tive embodiment these restrictions may also be a part of the 
editable layer of IMVs. Step 247 covers mathematical 
60 functions relative to selected databases. Mathematical func- 
tion modules (MFM's) allow a user to perform pre-defined 
operations. MFMs may or may not be needed in an IMA. 
This step may be omitted if no such functions are requested 
by a user or otherwise required in an application. 
65 In step 249, interactive media viewers (IMV's) are created 
using viewer modules adapted to view certain media of the 
type that stored interactions comprise. An IMV is a module 
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that may comprise one or more than one media viewer. Each 
of these viewer modules are editable (via software layer) and 
may function alone or as a component of a larger module 
(comprising more than one viewer). 

In step 251, closing modules are inserted to complete the 
application. For example, order modules arc one example of 
a closing modules. Modules adapted to return displayed 
results would be another example. Moreover, peripheral 
device API's may be inserted to allow results to be printed, 
faxed, sent over the network, etc. In this way, a supervisor 
reviewing the performance of a group of agents may report 
to other concerned parties such as managers, enterprise 
board members, or the like. 

The example as illustrated herein is basic but is deemed 
adequate by the inventor for illustration of one typical IMA 
building sequence. The description and order of steps may 
vary considerably. 

IMA's such as IMA 239 are transportable over a network 
and may be stored on a special applications server at 
network level, or within the communication center. In some 
embodiments, user's will be connected to the Internet when 
using IMA's allowing CINOS access. In other 
embodiments, agents may access CINOS resources while 
working off-hne with respect to the Internet. In such cases, 
logging on to CINOS is stiU required. 

It will be apparent to one with skill in the art that IMA 239 
as taught herein is interactive and displayable on a PCA^DU 
that is logged into CINOS through a WAN. However, this is 
not specifically required to practice the present invention, 
but rather preferred. Other embodiments may include pre- 
senting a Cn interface such as an IVR wherein a user may 
interact with the application via voice or touch tone 
response. 

In still another embodiment, such applications may be 
presented via external media such as on a floppy disk(s) or 
CD-ROM wherein a user may, by inserting the disk or CD, 
obtain the ability of accessing the enterprise via WAN, 
gaining access to CINOS, and performing an objective with 
the IMA. 

S to red-Media Interface Engine (Interaction Object Model) 
An object of the present invention is to allow certain 
CINOS systems to utilize data, such as data about 
customers, contacts, business associates, products and 
agents, to accomplish objectives and to effect improvements 
in overall system performance. Such data must be utilized 
very quickly in order to aid in influencing such system 
objectives as efficient routing to clients based on chent data, 
or as another example, generating an updated sales-volume 
report based on an entire customer base's latest transactional 
history. Certain CINOS automated systems will have to be 
able to make decisions in a time frame that would not be 
sufficient to allow physical accessing of actual media. 
Therefore, an innovative interface between stored multime- 
dia data and various CINOS intelligent systems is provided 
and taught below. 

According to a preferred embodiment of the present 
invention, a stored-media interface engine is provided in the 
form of an interaction object model (lOM). This unique 
convention provides a system-accessible abstract of all 
stored interactions within a multimedia communication cen- 
ter. 

FIG. 12 is a block diagram illustrating a relationship 
between a mass repository 263, an interaction object model 
(lOM interface) 253, and several data-interaction systems 
according to an embodiment of the present invention. Inter- 
action object model (lOM) 253 functions as a memory- 
based interface-engine between mass repository 263 and a 
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variety of CINOS data-interaction systems illustrated in this 
example as customer information system (CIS) 255, audit 
system (AT SYS) 257, routing system (RT SYS) 259, and 
automated services system (AS SYS) 261. It will be appar- 
5 ent to the skilled artisan that there may be many different 
interaction systems, and the ones illustrated here are exem- 
plary. 

Repository 263 is analogous to mass repository 187 of 
FIG, 7. It is logically divided into two sections. One section 

10 is for threaded text labeled Text-Based Data, and one is for 
multimedia storage labeled MIS Database. All of the com- 
munication center's interactions and transactions in this 
example are persistently stored in repository 263. 
Automated CINOS systems such as systems 255 through 

15 261 are adapted to interact with data stored in repository 263 
in order to perform their intended functions related to 
CINOS operation. For example, QS 255 uses data in 
repository 263 for presenting information to agent's at the 
time of or ahead of a live interaction. AT SYS 257 has to 

20 access and process data for generating system audits. RT 
SYS 259 requires data for intelligent routing purposes. AS 
SYS 261 uses data to update and configure services such as 
faxes, e-mails, voice messaging, and the like. 

lOM 253 is adapted to function as an interface between 

25 repository 263 (hard data) and the data interaction systems 
as described above. lOM 253 is an object model comprising 
objects as representations of stored files in repository 263, 
such as non-text files of recorded transactions. Each object 
making up the model is a representation of one such file. In 

30 a preferred embodiment, lOM is a COM-based model with 
which other CINOS COM-based applications may readily 
interact without language conversion interfaces. However, 
in other embodiments, API's may be provided where lan- 
guage difi[erences are present. 

35 lOM 253 has various capabilities in various embodiments 
which may include, among other functions, a search func- 
tion 265 adapted to accept parameters as a guide to obtain 
requested information from lOM memory (element 275). 
There is in this embodiment a data-mining function 267 

40 adapted for mining hard data and converting mined data into 
suitable code for applying to memory objects (represented 
interactions). A display function 269 is adapted to enable 
data results to be displayed on suitable screen monitors 
which may be associated with various data interaction 

45 systems as previously described. An API function 271 
provides appropriate interface for linking interaction-data 
systems such as systems 255-261 to lOM 253. An edit 
function provides editing ability to object parameters by 
system applications which may, in some instances be 

50 automated, or, in other instances, manned by administrators 
or knowledge workers. An object memory 275 is a single file 
containing all of the objects which represent all of the 
communication center's stored interactions. ' 
[OM 253 is run in much the same way as a standard 

55 relational object model as is known in die art, except that it 
is confined to text data and capable of multi-tasking 
(performing multiple simultaneous and unrelated functions) 
with respect to multiple system access. Another marked 
difference from a standard object model is the data mining 

60 functionality 267. In a preferred embodiment, function 267 
may be used to add additional data to lOM memory in real 
time. 

lOM 253 uses metadata, meaning data about data, in it's 
abstract representation of hard data files stored in repository 
65 2 63 similar to other data warehousing systems. Such meta- 
data may be, in some embodiments, compressed in memory 
for economy in storage. In a case such as that described 
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above, a compression and decompression function would be in terms of the broadest scope to which the present invention 

added to lOM 253. lOM 253 utilizes memory area 275 for should be afforded. 

storing metadata objects a-z as illustrated. Metadata objects In step 277, a request to access an lOM such as lOM 253 

a-z, as illustrated, each represent a single transaction or of FIG. 12 is received from a data-interaction system such 

interaction file stored in repository 263. Hence, the number 5 as RT SYS 259 of FIG. 12. In step 279, the lOM is activated 

of actual objects stored in memory 275 will equal the to receive commands related to a dedicated operation or 

number of interactions stored in repository 263, if every pre-defined process. Activation in this sense is defined as 

stored transaction is shadowed in the lOM. activation to receive from or communicate with a specific 

lOM 253 is innovative in the fact that it is an object model requesting system, 

interface used as an accessible abstract representation of lo In step 281 commands arc sent to the lOM for the purpose 

hard data files. Therefore, data-interaction systems may of initiating lOM functions as may be desired. In step 283, 

typically utilize lOM 253 in performing their dedicated the lOM performs the requested function or functions. In 

functions without accessing any hard data stored in reposi- this case, the function or functions are adapted to provide 

tory 263. The inventor knows of no system wherein data information to be used in routing of a new interaction. A 

systems may obtain stored information to aid their dedicated 15 simple example of a routing-related function would be to 

functions in the manner and with the apparatus described return the information associated with the identified client* s 

above. last 5 interactions in order to determine a best fit agent to 

Memory 275 is typically located in repository 263 as is accept the new interaction. If it is determined that the last 5 

the rest of lOM functionality as illustrated via directional interactions are leading to a purchase, and the prominent 

arrows emanating from repository 263 and pointing to a 20 agent involved in the last 5 interactions is identified, then the 

separate lOM 253. Software adapted to communicate with new interaction may be held for that agent in the hopes that 

lOM 253 (not shown) may reside in each of the data- statistically, he is more likely to obtain a new order from the 

interaction systems 255-261 as illustrated via directional client. However, if the last 5 interactions are stagnant or 

arrows pointing to API function 271. The above described leading away from a purchase, than the interaction may be 

relationship is not specifically required to effect the goal of is routed to a new agent, perhaps with more skill at motivating 

the present invention, but rather preferred in it's practice. clients to buy, and so on. 

I CM 253 may reside on a separate database that is linked to In step 285, displayable results from performed functions 
repository 263. Similarly, API function 271 may contain all are returned to requesting systems. In some instances, results 
of the necessary components for interface with all commu- will not be required to be human readable or to be display- 
nication center data-interaction systems without requiring 30 able on a monitor. However in other instances, this may be 
each system to host software. There are many differing required such as an instance wherein data about a client is 
architectural possibilities. forwarded to the receiving agent ahead of the cUents inter- 
According to an embodiment of the present invention, action. 
lOM 253 is continually updated in real time as interactions It will be readily apparent to the skilled artisan that the 
may be stored or deleted in repository 263. Rules-based 35 process steps described above may vary in number and 
routines determine what type of data will be used in each description according to type of business, type of data- 
meta-data object stored in memory 275. Typically, enterprise interaction system requesting information, enterprise rules, 
important information such as client ID, client parameters, and type of data accessed. This basic example is meant to 
transactional analysis (such as profitability rating), credit provide a broad scope of functionality, 
rating, and so forth, will accompany more interaction- 40 Interactive Modules for Managing Btisiness Processes 
specific data, such as media type, interaction date, partici- In a preferred embodiment of the present invention, a 
pating party ID's and their parameters, and any parsed multimedia communication center operating CINOS accord- 
information specific to the interaction and known to be ing to previous co-related embodiments is provided, as part 
required by one or more of the automated services. of CINOS, a means to initiate and manage various business 
Interaction-specific information may include interaction 45 processes related to conmiunication workflow. Such busi- 
purpose or goal, interaction results such as purchase ness processes are defined as enterprise-created applications, 
information, resolved issue information, and so on. procedures and so forth, that are adapted to return a result or 
Memory objects, such as objects a-z representing provide a solution regarding an issue or request made by a 
interactions, are not only identified with regards to involved client or other entity. 

parties as previously described, but may also be identified so As briefly described in the background section above, in 

and associated according to the common thread order of a multimedia communication center it is desired to automate 

interaction as represented in repository 263, or more business processes where possible and to be able to break 

specifically, the text-based portion which is threaded dialog. down the processes into tasks and sub-tasks that are strictly 

It will be apparent to one with skill in the art that an lOM controlled and timed. Prior art network systems require 

such as lOM 253 may be utifized with databases other than 55 considerable human intervention while proceeding with a 

repository 263 without departing from the spirit and scope of business process while, for example, a client waits for a 

the present invention. For example, lOM 253 may also be resolution. Similarly, more time is consumed because actual 

used as a system interface to product information databases, media and hard data may be accessed and processed without 

external knowledge databases, or virtually any other data- the benefit of an abstract representation of data (metadata) as 

base such as may be connected to CINOS or a similar 60 discussed above relative to an interaction object model 

operating system. (lOM). Therefore, an Interactive Process Model (1PM), is 

FIG. 13 is a flow chart illustrating interactive steps provided as a generic programmable module, which when 

associated with lOM functionality according to an embodi- complete, represents and conducts a defined business pro- 

ment of the present invention. The following basic example cess. An IPM according to this invention has ability to obtain 

of lOM functionality is meant to iUustrate just one possible 65 data from an lOM and to manage business applications in 

sequence of logical steps taken when utilizing lOM 253. terms of timing and execution of main tasks and sub-tasks 

This example should in no way limit the present invention that are programmed according to enterprise rules. 
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FIG. 14 is a Gant table illustrating a pre-defined business 
process according to an embodiment of the present inven- 
tion. A Gant table 287 represents the tasks and sub-tasks of 
a business procedure, in this case qualifying an exemplary 
loan application, as they might appear on a programmers s 
screen after an automated execution sequence has been 
completed. Gant table 287 will hereinafter be termed Inter- 
action Process Model (IPM) 287 for the purpose of simpli- 
fying explanation. 

IPM 287 is a programmable interactive engine as previ- lO 
ously described. That is, one may program IPM 287 accord- 
ing to various tasks and sub-tasks that may be required for 
the execution of a particular business process. After basic 
programming or set-up, 1PM 287 has the capability of 
accessing data from, among other possible sources, the lOM is 
described above, and using that data in the execution of it's 
intended goal. IPM 287 is innovative in the fact that it begins 
as a generic object model (for example a COM container) in 
which a programmer may add specific functionality (COM 
objects) to create a functional interface engine or model that 20 
may execute a timed business procedure according to enter- 
prise rules. 

Although IPM 287 is, in this case, a loan application 
process, such an IPM may be programmed to execute 
virtually any conceivable business process that an enterprise 25 
may offer as a wholly or partially automated service to 
clients. IPM 287, in this example, is presented as a series of 
rows and columns comprising entry fields and return fields 
in a GANT chart. For example, before the desired function- 
ality is inserted into IPM 287, it is a generic COM model that 30 
is adaptable via programming for various business processes 
and resource interface as previously described. It will be 
apparent to those with skill in the art that a COM model and 
a GANT form arc each simply exemplary of known devices 
that may be employed in practicing the invention 35 

The format of entry and return fields presented herein is 
not required to practice the present invention. The inventor 
merely deems this particular format to be friendly to a 
programmer building the model and analyzing the returns 
such as may be displayed on a computer screen. A tool kit 40 
aids a programmer with building and fine tuning an IPM 
such as IPM 287. Such a tool kit may be part of the 
programmers desk-top CINOS application such as perhaps 
tool kit 125 of RG. 4, or may reside in and be accessible 
from a server hosting a CINOS Manager application such as 45 
server 77 of FIG. 1. 

FIG. 14 is a GANT chart for a process executable by a 
CINOS operating system according to an embodiment of the 
present invention. This chart in this embodiment is an 
interactive input and display and editing interface wherein a 50 
programmer may program a business process having dis- 
crete steps and sub-steps. It will be apparent to the skilled 
artisan that such an interface is but one of a number of 
interfaces that would be suitable for the purposes of the 
invention, and is meant to illustrate features of the invention. 55 
Broadly speaking, by listing steps of a process in this chart 
along with parameters to be described more fully below, an 
application module is created which, by execution, performs 
the process step by step, and tracks completion of individual 
tasks, as well as providing reminders when and if allotted 60 
completion times are pending or exceeded, and so forth. It 
will be apparent to the skilled artisan that GANT processes 
may also be illustrated by flow diagrams (typically PERT 
charts), and, in a preferred embodiment, the chart depicted 
in FIG. 14 may be converted to an editable GANT flow chart 65 
as well. For Example, standard products like MSProject 
Planner may be used to generate a PERT or GANT chart, 
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and by using certain labels both for steps and resources, the 
generated file may directly become an IPM Object. 

Referring again to FIG. 14, a title row 289 comprises 
column headers and a link to a pop-up editing window that 
provides for entering steps and necessary parameters. The 
pop-up window in a preferred embodiment has input fields 
for entering task numbers, specific action for the task, 
sequence and pre-requisites related to other tasks, allotted 
time to complete, and notification parameters, as well as a 
Cancel and a Save function. Through the input window a 
programmer can design and relate all tasks and sub-steps 
needed for a process. 

Because IPM 287 is a container for COM objects, task 
objects may also be loaded as required by the programmer 
in order to set up the main and sub -tasks inherent to the 
process as previously described such as by drag and drop 
method as is known in the art. For example, certain objects 
or modules to be inserted are for access to certain data from 
the lOM, while other objects are adapted for accessing 
certain other databases or resources, or for performing 
certain process-related functions. 

A variety of notification/command modules may be 
inserted into IPM 287 according to possible results or states 
that may appear during process execution. The actual mod- 
ule that will be invoked will depend in part on the 
programmer, and in part on the process sequence. Some of 
the windows are return windows that return results during 
execution of the process. These are windows in the columns 
labeled time begin, time end, and actual time. 

In this embodiment, as a programmer enters new steps 
and sub-steps in building a new application module, the step 
numbers with name and generic parameters appear as new 
rows. When the last step is entered and configured the 
GANT chart is complete, and the process is ready to invoke 
and execute, 

A completed chart is editable in the sense that steps and 
sub -steps may be altered, added, deleted, and the like, along 
with names, allotted times, action parameters, and the like. 
A programmer may therefore select an existing application 
module and edit it to save as a new application module. 

When a module is complete the application created may 
be stored and related to other tasks such that the application 
may be called whenever necessary to perform functions for 
the operating system. Such processing will typically be 
transparent to agents, clients, knowledge workers and the 
like, but on certain occasions, by need, a chart may be 
displayed while a process is running or for other diagnostic 
purpose. 

In general, building modules (objects) contained in a 
programmers tool kit are generic to the basic processes 
being created by the enterprise including standard interface 
and command objects to other resources or CINOS systems. 
These btiilding objects used to program IPM 287 may be 
provided by the provider of the CINOS system according to 
the general type of business and system architecture used by 
the enterprise. In one embodiment, an enterprise program- 
mer may create the building objects according to desired 
enterprise functionality and custom CINOS architecture. 
Therefore, one CINOS system software package may be 
provided specifically for a loan company while another 
CINOS system software package may be provided for an 
investment firm and so on. 

Referring now back to FIG. 14, as a programmer defines 
steps and sub-steps as tasks to be performed, he/she is 
setting up the main tasks and sub -tasks that the application 
will perform when executed. In this particular example, task 
1 is a pre -qualification task for a loan as evidenced by the 
name Pre-Qual in window 291 in the Name column. 
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Task 1 comprises 3 sub-tasks, namely sub-task la, sub- 
task Iby and sub-task Ic. Sub-task la comprises a module for 
obtaining data from a general credit field such as may be 
stored in a database and represented via metadata in the lOM 
described above. Hence, sub-task la would comprise the 5 
necessary modules or objects for interface with the lOM 
previously described above and for obtaining general credit 
data which may be an enterprise rating system code derived 
from actual credit reports. Additional related data may also 
be accessible in step la such as a list of creditors, payment lO 
history, and so on. Step lb provides access to data about 
credit to the enterprise, and step Ic provides access to data 
about income such as total monthly income, source of 
income, etc. In this way, main task 1 may be completed by 
executing the sub-tasks lal4 Ic. 15 

In building an IPM such as IPM 287, a goal is to provide 
an interfacing process application that may execute and 
perform an entire business process from start to end accord- 
ing to CINOS constraints, time constraints, and enterprise 
rules. Once completed, tested, and fine tuned, an IPM such 20 
as IPM 287 may be used as a functional model for the 
business process that it represents. 

Column 293 represents a time that each step and sub -step 
begins executing within the CINOS system. Numerals illus- 
trated in column 293 represent units of time expired as the 25 
process is executed. For example. Main task 1 named 
Pre-Qual begins at 0000 (the time that the application is 
invoked). A client who is requesting a loan via telephone or 
other media may invoke IPM 287 thus beginning it's auto- 
mated execution while the client wails in queue. In some 30 
embodiments, wherein a client is not live in queue, an agent 
may initiate the process based on a not-live request such as 
an e-mail or fax. In general the lime displayed in windows 
under TIME Begin are returns only, based on the actual 
times related and previously required steps are completed. 35 
That is, typically a task will not begin at a fixed lime from 
0000, but will begin as soon as pre-requisite tasks are all 
completed. 

Windows in column 295 show the time that a step actually 
ends. This is typically a return window as well, and the time 40 
displayed will be the begin time plus the task elapsed time 
to completion. The programmer typically allots a time for 
each task, and the actual time may be more or less than the 
allotted time. Other actions may be invoked in the case that 
the actual time exceeds the allotted time. 45 

All sub-steps under a main task typically are allotted time 
increments (according to completion goal) of the allotted 
time for the main task such that the their sum equals the time 
allotted for the main task. The purpose for allotting time 
segments for each task and sub-tadc is so thai efiSciency 50 
improvements may be pursued with regards to client waiting 
and system performance and that interfaces with other 
systems such as routing systems or the like are handled 
smoothly. The time allotments, as described are in effect, 
time goals set by the enterprise. Time modules (not shown) 55 
are COM tools inserted by the programmer. 

Windows in column 297 represents return fields that 
return actual elapsed times associated with each task and 
sub-task. For example. Main task 1 (Pre-Qual) began at time 
0000. Allotted time for main task 1 is 0010. Main task 1 was 60 
actually completed at time 0008 or 0002 ahead of schedule. 
As is the case with column 295 (Time End), times in which 
the associated sub -tasks are completed are increments whose 
sum equals the actual time for the main task to obtain 
completion. 65 

Windows under column 299 contains notification fields 
under the name-field Notify, which is part of title row 289, 
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If there are no problems in the execution of a task or sub- task 
then notification is given to go on to the next task or 
sub -task. However, if there are problems in execution such 
as operation time out, or insufficient data for return, then a 
suitable notification-command may be given to the system 
such as return to agent, repeat prior task or sub-task, and so 
on. 

It is important to note here that according to enterprise 
rules, notification may include stopping the process and 
requesting human intervention, allowing more allotted time 
for a task or sub-task to complete and then repeating the task 
or sub-task, or any variety of other options. 

In this example, IPM 287 comprises 4 main tasks of 
which main task 1 has already been described. Main task 2 
is determination of loan type. IPM 287 may comprise tasks 
or sub-tasks that may be executed in parallel under certain 
circumstances. Such is the case with part of main task 2 or 
more specifically sub-task 2a. For example, choices and data 
regarding loan type, amounts of loan, purpose for loan, and 
the like may be held in a separate section or database such 
as product database or the like. Therefore the multi-taskable 
IPM 287 may begin main task 2 upon invocation at time 
0000. However, because a sub-task 2b requires the same 
data obtained with regards to main task 1, it cannot begin 
until main task 1 is complete or at 0008 as indicated in 
column 293, 

A sub-task 2Z>1 is depended from sub- task 2b and is a data 
sorting operation. An example would be the sorting of assets 
from liabilities. Sub-task 2c allows insertion of data on a 
selected interactive or multimedia loan application in an 
automated fashion. Hence, the first 2 Main tasks and their 
associated sub-tasks pre-qualifies a client and obtains and 
inserts required data into an interactive application. For the 
purpose of this example, there have been no errors or 
problems with the finst 2 main tasks allowing all notifica- 
tions to proceed with the process without human interven- 
tion, 

IPM 287 includes a main task 3 for post qualification and 
data validation. Such a task may be required according to 
enterprise rules with a system recommendation to be 
returned regarding weather or not a particular client should 
quahfy. It siiould be noted here that a small amount of time 
elapses between a main task and a first sub-task with regards 
to main tasks 1-3 this is meant by the inventor to show 
system preparation time to execute to first sub-tasks. 

Under main task 3, a sub-task 3a validates income. For 
example, a a client's income data, instead of being current, 
may be out of date according to a time constraint imposed 
by the enterprise for updating income data in a database. If 
this is the case, then a suitable notification may be made to 
the system. The process may be temporarily halted due to the 
notification while an I VR interacts with the client to provide 
more current data. After the client has provided the data, it 
is updated to the lOM and sub-task 3a may be repeated. In 
some embodiments, subsequent tasks or sub -tasks in a 
process may be executed while an IVR solicits more data 
from the client provided that they are not critically tied to the 
problem task or sub-task that could not be completed. 

A sub-task 3b vahdates the applicant's source of income, 
perhaps by accessing a current database containing employ- 
ment records provided by the client's employer. In one 
embodiment, an automated out-dialer may be used to con- 
tact the employer. When connection is made, the call may be 
transfer to an IVR or a live attendant so that validation may 
be completed. In some cases this will take more than the 
allotted lime shown in this example because human inter- 
vention is utilized. In such cases where it is known or 
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perceived that human intervention will be required, then 
more time will be allotted for the planned purpose. However, 
if the required data is supplied ahead of the loan application 
and stored for access by IPM 287, no human interface will 
be required. 5 

Similarly, a sub-task 3c may prompt the client via IVR or 
live attendant for inclusion of any added income such as may 
not be indicated in data storage such as spousal income, an 
additional job-income source, and so on. Such IVR or live 
attendant interaction may be part of the loan procedure with lO 
appropriate time allotted to complete such procedures and 
not specifically the result of a problem or notification. 
Therefore, the amount of human intervention included in a 
business process such as represented by IM 287 may be 
dictated by enterprise rules. is 

A sub -task 3d calculates the debt to income ratio and other 
required calculations or manipulations of data and then 
makes a system recommendation, based on the calculation 
and enterprise rules, to the agent to which the client will be 
transferred for closing. Hence, the notify field for sub -task 20 
3d is labeled present. Upon receiving the present 
notification, the system forwards the information (completed 
loan application) to an agent ahead of the client's call. An 
interface to the automated routing system enables IPM 287 
to determine which agent will receive the client out of 25 
queue. 

Amain task 4 is simply to display, on an agent's graphical 
user interface (GUI) a completed copy of the loan applica- 
tion associated with the client's identification and incoming 
call. The notification field returns END at task 4 because it 30 
is the end of the procedure. At this time, a copy of IPM 287 
with all of the fields complete may be sent to the program- 
mer or system administrator as indicated on a top row 
comprising the label field (loan apphcation), Time begin 
field (0000), Time End field (00305), Actual Time field 35 
(00255), and an update notification option labeled Update. 

In this example, the actual time of 00255 for completing 
a loan application and routing it to an agent is 0005 ahead 
of the allotted time or goal time. The programmer may elect 
to update IPM 287 as the most efiScient model yet created 40 
thereby using it again for subsequent applications, or he may 
elect to fine tune IPM 287 further based on the information 
provided in the returned model. 

Each Interactive Process Module created is adapted to 
operate with a CINOS operating system according to the 45 
present invention. As such, each completed module is call- 
able by the OS when needed to perform its programmed 
function. Further, each module is provided with one or more 
inputs to be able to perform its function. In the example of 
qualifying a loan applicant as described above, the required 50 
inputs will be such as (a) potential borrower's identity, (b) 
type of loan desired, (c) amount of loan requested, and (d) 
payback period requested. Moreover, each module is 
adapted to interact with other CINOS modules. For example 
the loan qualification application described is adapted to 55 
access other modules, such as the lOM, using the potential 
borrower's ID as a key, to recall information, such as income 
information. Generally speaking, process modules will have, 
then, certain commonalties, such as at least one defining 
input, a task to be performed based on input, and a result to 60 
be returned, as well as a facifity for returning the result. Such 
results may in some cases be Yes/No, a recommendation or 
the like, and may be either displayed for a recipient or used 
as a further input to another Interactive Process Module. 

It will be apparent to one with skill in the art that one IPM 65 
may be employed for one business process containing 
various secondary alterations to the generic process without 
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departing from the spirit and scope of the preset invention. 
For example, a mortgage loan may have differing tasks and 
sub-tasks than an auto loan and so on. However, because 
access to system repositories and resources arc similar in 
most loan processes regardless of type or amount of loan, 
modules may be inserted that cover the options. Moreover, 
separate business processes may be run from one IPM as 
long as the required modules arc present and operational. 

It will further be apparent to one with skill in the art that 
the present invention may utilize a convention other than 
COM such as by Java applet or the like. 

As previously described, IPM 287 is innovative in part 
because a generic application or model may be used for 
building several differing automated processes, and because 
it breaks down a process into tightly controlled tasks and 
sub -tasks that are executed in conceit through interface with 
other CINOS systems. As a result, complicated business 
processes may be executed within CINOS much faster and 
more efBciently than with prior art systems. Furthermore, 
processes may in many instances be wholly automated and 
integrated with system routing and other intelligent services. 

It will be apparent to one with skill in the art that CINOS 
may be implemented in a single communication center, or in 
a plurality of communication centers linked via WAN with- 
out departing from the spirit and scope of the present 
invention. 

It will also be apparent to one with skill in the art that rules 
may be created which govern access to CINOS without 
departing from the spirit and scope of the present invention. 
For example, customers may be required to subscribe to 
CINOS, and may also be provided with a customer appli- 
cation enabling such access. In another embodiment, access 
may be given to the general public according to established 
security rules governing commerce, financial transactions, 
and other processes. 

There are many existing and future implementation 
opportunities for an interaction operating system such as 
CINOS many of which have already been stated. The spirit 
and scope of the present invention is limited only by the 
claim that follow. 

What is claimed is: 

1. In an operating system (OS) for a multimedia commu- 
nications center (MMCC), an interactive process module 
(IPM) for accomplishing a process, comprising: 

a data repository for storing interactions and transactions 
of the MMCC including at least COST calls, data 
network calls (DNT), voice messages, e-mails and 
faxes; 

an interaction process module (lOM) for accessing and 
providing data from the data repository; 

a plurality of code sets operating in the IPM, each adapted 
to completion of a specific task in the overall process; 

an input interface for providing one or more inputs to the 
IPM; and 

an output function for returning a result; 

wherein the plurality of code sets are related by pre- 
requisite status, creating a required order of progression 
for the process, the process is initiated after being 
called by the OS and receiving required inputs, the IPM 
interfaces with the lOM completing tasks including at 
least one of calculations, manipulations and analysis of 
data from the repository, and upon completion of the 
last task the IPM returns the result. 

2. The IPM of claim 1 wherein task structure and param- 
eters are presentable in a graphical interface displaying tasks 
making up the IPM in prerequisite order. 
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3. The IPM of claim 2 wherein the graphical interface is 
a GANT chart, 

4. The IPM of claim 2 wherein the graphical interface is 
interactive, alio wing a programmer to add, delete, and edit 
steps in the process. 

5. The IPM of claim 2 wherein start and finish times are 
displayed for each task. 

6. The IPM of claim 1 wherein, in performing any one 
task, next activity is variable, and is determined by perfor- 
mance to requirements programmed with the task. 

7. The IPM of claim 6 wherein the task requirements 
include completion within a preprogrammed allotted time. 

8. The IPM of claim 7 wherein next activity includes a 
choice of stopping the process and notifying a person in the 
event of non-completion of a task in an allotted time. 

9. The IPM of claim 7 wherein one or more tasks require 
human intervention and activity, and comprising an activity 
of reminding a person responsible for an activity of a 
pending time deadline. 

10. An operating system (OS) for a multimedia call center 
(MMCC) comprising one or more interactive process mod- 
ules 0PMs) for accomplishing individual processes, each 
IPM comprising: 

a plurahty of code sets, each adapted to completion of a 

specific task in the overall process; 
an input interface for providing one or more inputs to the 

IPM; and 

an output function for returning a result; 

wherein the plurality of code sets are related by pre- 
requisite status, creating a required order of progression 
for the process, the process is initiated after being 
called by the OS and receiving required inputs, the IPM 
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interfaces with other OS modules for completing tasks 
including at least one of calculations, manipulations 
and analysis of data from a data repository storing 
interactions and transactions of the MMCC including at 
least faxes, e-mails, voice messages and records of live 
COST and data network telephony (DNT) calls, and 
upon completion of the last task the IPM returns the 
result. 

11. The OS of claim 10 wherein task stmcture and 
parameters are presentable in a graphical interface display- 
ing tasks making up the IPM in prerequisite order. 

12. The OS of claim 11 wherein the graphical interface is 
a GANT chart. 

13. The OS of claim 11 wherein the graphical interface is 
interactive, allowing a programmer to add, delete, and edit 
steps in the process. 

14. The OS of claim 11 wherein start and finish times are 
displayed for each task. 

15. The OS of claim 10 wherein, in performing any one 
task, next activity is variable, and is determined by perfor- 
mance to requirements programmed with the task. 

16. The OS of claim 15 wherein the task requirements 
include completion within a preprogrammed allotted time. 

17. The OS of claim 16 wherein next activity includes a 
choice of stopping the process and notifying a person in the 
event of non-completion of a task in an allotted time. 

18. The OS of claim 16 wherein one or more tasks require 
human intervention and activity, and comprising an activity 
of reminding a person responsible for an activity of a 
pending time deadline. 
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